Search results

CLI: llama-cli and llama-completion cosmetics

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

pythonpython script changespython script changes

scriptScript relatedScript related

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Open (in progress).

ggml-org/llama.cppnumber 18053

#18053 In ggml-org/llama.cpp;

· andrew-aladev opened on Dec 15, 2025

on opencl added note for pre SYCL Intel hardware

documentationImprovements or additions to documentationImprovements or additions to documentation

OpenCLIssues specific to the OpenCL backendIssues specific to the OpenCL backend

Status: Open (in progress).

ggml-org/llama.cppnumber 18016

#18016 In ggml-org/llama.cpp;

· alosslessdev opened on Dec 14, 2025

Add message for pre-RDNA AMD GPU support via opencl

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open (in progress).

ggml-org/llama.cppnumber 18015

#18015 In ggml-org/llama.cpp;

· alosslessdev opened on Dec 14, 2025

Clarify that steps also apply to linux

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open (in progress).

ggml-org/llama.cppnumber 18002

#18002 In ggml-org/llama.cpp;

· alosslessdev opened on Dec 13, 2025

Add Support for Microsoft Phi-3.5 Vision Instruct Models

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

buildCompilation issuesCompilation issues

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

scriptScript relatedScript related

server

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Draft (not ready).

ggml-org/llama.cppnumber 17687

#17687 In ggml-org/llama.cpp;

· z-manoj opened on Dec 2, 2025

CANN: add operator fusion support for ADD+RMS_NORM operations

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

Status: Open (in progress).

ggml-org/llama.cppnumber 17512

#17512 In ggml-org/llama.cpp;

· noemotiovon opened on Nov 26, 2025

docs: build llama.cpp using MSVC - Visual Studio 17 2022

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open (in progress).

ggml-org/llama.cppnumber 17510

#17510 In ggml-org/llama.cpp;

· trevorsandy opened on Nov 26, 2025

vulkan : add dynamic VRAM heuristic for low-VRAM GPUs

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 17485

#17485 In ggml-org/llama.cpp;

· cafeTechne opened on Nov 25, 2025

docs: vulkan add GGML_VK_ALLOW_SYSMEM_FALLBACK=1 docs

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open (in progress).

ggml-org/llama.cppnumber 17436

#17436 In ggml-org/llama.cpp;

· taronaeo opened on Nov 22, 2025

CUDA: add CONV_3D operator support

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 17255

#17255 In ggml-org/llama.cpp;

· YaelGitAccount opened on Nov 14, 2025

llama.android : Rewrite Android binding

androidIssues specific to AndroidIssues specific to Android

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 17152

#17152 In ggml-org/llama.cpp;

· hanyin-arm opened on Nov 10, 2025

Add MoE dynamic routing with expert caching

buildCompilation issuesCompilation issues

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

Status: Draft (not ready).

ggml-org/llama.cppnumber 17044

#17044 In ggml-org/llama.cpp;

· jmangold23 opened on Nov 6, 2025