AI Aulis

AI NEWS IN ENGLISH · 14 November 2026

The most important AI news every morning. AI writes and checks the stories against the original sources – check important facts in the sources.

← Issue 14 November 2026Paper

llama.cpp 1.0: API-breaking changes will now bump the major version

AI-generated contentWritten by AI

github.com, huggingface.co, x.com, tbreak.com · 7 sources · Sources published: 13 November 2026

llama.cpp and its ggml library have reached version 1.0.0, and the maintainers promise that changes that break the API will bump the major version from now on. Version 1.0 itself removes deprecated functions and tightens server security.

In a Hugging Face blog post on 13 November, the maintainers announced that llama.cpp is moving to stable versioning. The same day, version 1.0.0 of both llama.cpp and ggml, the tensor library it runs on, appeared on GitHub. The previous version was 0.9.0.

llama.cpp is a C/C++ library for running large language models on your own hardware, from consumer machines to enterprise servers. Many applications already depend on the project, wrote the blog’s authors, Daniel Bevenius, Georgi Gerganov and merve: ‘Every new integration means more developers depending on our library interfaces and therefore having a flexible but stable API is paramount.’

The promise covers the API – the functions that an application’s code calls – and the ABI (application binary interface), which compiled programs rely on. From now on, any change that breaks the public C API will raise the major version number. Backward-compatible additions, such as support for new models and hardware support updates, raise the minor version. Bug fixes that leave the API unchanged raise the patch version. Superpower Daily, as quoted by Tbreak, said the version is a message to developers and does not mean a freeze on changes.

Version 1.0 removes the old API

Version 1.0 itself breaks compatibility. According to the GitHub release notes, llama_set_warmup, 35 deprecated functions and the defrag_thold setting are removed from the llama.h header, and the --defrag-thold option is removed from the command line. Code and launch commands that use them must be updated.

The NextN API moves from the llama-ext.h header to llama.h. It is intended for speculative decoding, in which the main model checks a draft of the upcoming text in one pass. The function llama_set_embd_state_src is now called llama_set_ctx_state_src. The multimodal clip.h header has been removed and its code merged into the mtmd library.

The server requires explicit opt-in for risky actions

llama-server is now protected against SSRF attacks, in which an attacker makes the server fetch internal network addresses. The release also fixes the handling of the --cors-origins setting and the protection against DNS rebinding attacks. Browsers can no longer directly reach instances that the server launches.

The changelog says tools must now be enabled explicitly with --allow-unauthenticated-tools when they are used without authentication through an address other than the local machine’s (loopback). Media can be fetched from private network addresses only with --media-allow-private-urls. The server now sends HF_TOKEN only to huggingface.co hosts. If the client disconnects or a timeout is reached, the server cancels running MCP tool calls and notifies the MCP server.

Other changes

New features include an FP8 KV cache, in which the model stores intermediate results for text it has already processed. Other additions are a main-memory cache for the experts in mixture-of-experts (MoE) models, the new text models Kimi-K3.1-Pro, Ripple and xing4_0, drama-3 speech synthesis, an OpenAI-compatible /v1/audio/speech API and a redesigned web interface.

The open-source llama.cpp supports more than 150 model architecture variants, the blog says. The GitHub release page offers prebuilt binaries for Linux, macOS, Windows, Android and iOS. The library is also distributed via Docker, Debian, Homebrew and Winget, among others, the blog adds.

Report an error in this story