TToolora

Side by side

Compare tools

2 tools selected

← Keep browsing

llama.cpp

Run LLMs locally with pure C/C++

Toolora score97Open source
Get it here↗

Free / open source

Jan

Open-source desktop app for local chat models

Toolora score89Open source
Get it here↗

Free / open source

Specllama.cppJan
CategoryAI ToolsAI Tools
PricingFree / open sourceFree / open source
Toolora score97/10089/100
Best forgithub, local-llm, open-source, inferencelocal-llm, desktop, open-source, chat
Top features
  • ·CPU and GPU backends
  • ·GGUF model format
  • ·Quantisation support
  • ·Local model chat on desktop
  • ·OpenAI-compatible API mode
  • ·Extension and assistant setups