ccs/config/base-llamacpp.settings.json at 14da76abae511f020bfa67d9b2b57342ebdc27fa - ccs - Gitea: Git with a cup of tea

tiennm99/ccs

mirror of https://github.com/tiennm99/ccs.git synced 2026-07-16 08:17:11 +00:00

Files

T

Huynh Duc Dung 0ca6428554 feat(api): add llama.cpp support as local model provider

- Add llamacpp provider preset to provider-presets.ts
- Add base-llamacpp.settings.json configuration
- Update help-command.ts with ccs llamacpp documentation
- Update UI provider presets for dashboard parity

llama.cpp is a popular C++ inference engine for LLaMA models.
This complements existing Ollama support for local inference.

Usage: ccs llamacpp (requires llama.cpp server on port 8080)

Closes #690

2026-03-05 12:29:49 +08:00

11 lines

296 B

JSON

Raw Blame History

 {
   "env": {
     "ANTHROPIC_BASE_URL": "http://127.0.0.1:8080",
     "ANTHROPIC_AUTH_TOKEN": "llamacpp",
     "ANTHROPIC_MODEL": "llama3-8b",
     "ANTHROPIC_DEFAULT_OPUS_MODEL": "llama3-70b",
     "ANTHROPIC_DEFAULT_SONNET_MODEL": "llama3-8b",
     "ANTHROPIC_DEFAULT_HAIKU_MODEL": "llama3-2b"
   }
 }