Skip to content

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Sign in

Sign up

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

ggml-org / llama.cpp Public

Notifications You must be signed in to change notification settings
Fork 14.1k
Star 91.4k

LLM inference in C/C++

License

MIT license

91.4k stars 14.1k forks Branches Tags Activity

Star

Notifications

You must be signed in to change notification settings

Code
Issues 348
Pull requests 624
Discussions
Actions
Projects 10
Wiki
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Wiki
Security
Insights

ggml-org/llama.cpp

About

LLM inference in C/C++

Topics

ggml

Resources

Readme

License

MIT license

Contributing

Security policy

Uh oh!

There was an error while loading. Please reload this page.

Activity

Custom properties

Releases 4,902

b7442 Latest

Dec 17, 2025

+ 4,901 releases

Packages

Uh oh!

There was an error while loading. Please reload this page.

Uh oh!

There was an error while loading. Please reload this page.

Contributors 1,376

+ 1,362 contributors

Languages

C++ 56.3%
C 12.2%
Python 7.9%
Cuda 6.6%
HTML 4.6%
Metal 2.1%
Other 10.3%

Footer

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.

License

ggml-org/llama.cpp

About

Topics

Resources

License

Contributing

Security policy

Uh oh!

Stars

Watchers

Forks

Releases 4,902

Packages 0

Uh oh!

Uh oh!

Contributors 1,376

Languages

Packages