go-openapi-compat/GEMINI.md

Go OpenAI-Compatible Client for llama.cpp

This gem provides a Go implementation of an OpenAI-compatible API client that interfaces with llama.cpp models. It enables seamless integration with LLMs deployed via llama.cpp, supporting common APIs like chat, embeddings, and image generation. Features include:

• REST API compatibility with OpenAI's model
• Support for various model formats (GGUF, GGML)
• Configuration via environment variables
• Request/response streaming support
• Token counting and usage metrics
• Batch processing capabilities
• Flexible prompt templating
• Error handling with retry logic