AI Tool Index

Home › AI Developer Tools › llama.cpp

llama.cpp

Open-source C/C++ library for running language models efficiently on local hardware.

Category
AI Developer Tools
Pricing model
Free Free to use. Source: https://github.com/ggml-org/llama.cpp
Official site
https://github.com/ggml-org/llama.cpp
Link checked
2026-10-31. Added 2026-10-31.

Visit llama.cpp →

This entry gives the product's category, the pricing model as shown on the vendor's own pages when we could confirm it, and a link to the official site. It is not a review or an endorsement. Plans and prices change, so confirm on the vendor's site.

Other AI Developer Tools tools

ToolWhat it doesPricingLink
MLflowOpen-source platform for managing the machine learning and GenAI lifecycle.FreeOfficial site
OpikOpen-source platform from Comet for evaluating and monitoring LLM applications.See siteOfficial site
OutlinesLibrary for constraining language model output to defined structures.FreeOfficial site
PromptfooOpen-source tool for testing and red-teaming prompts, models and agents.See siteOfficial site
RagasOpen-source toolkit for evaluating retrieval-augmented generation applications.FreeOfficial site
RayOpen-source framework for scaling Python and AI workloads.FreeOfficial site
RoboflowComputer vision platform for labeling, training and deploying models.FreemiumOfficial site
StreamlitPython framework for building data and AI web apps.FreeOfficial site

All AI Developer Tools tools · Best AI tools for AI development and operations