Initial commit

This commit is contained in:
2026-05-10 11:40:53 +02:00
commit 140d736fc7
16 changed files with 1917 additions and 0 deletions
+15
View File
@@ -0,0 +1,15 @@
# Go OpenAI-Compatible Client for llama.cpp
This gem provides a Go implementation of an OpenAI-compatible API client that interfaces with llama.cpp models.
It enables seamless integration with LLMs deployed via llama.cpp, supporting common APIs like chat, embeddings, and image generation.
Features include:
- REST API compatibility with OpenAI's model
- Support for various model formats (GGUF, GGML)
- Configuration via environment variables
- Request/response streaming support
- Token counting and usage metrics
- Batch processing capabilities
- Flexible prompt templating
- Error handling with retry logic
```