Documentation / modules
Inference
Invoke and stream model requests through explicit descriptors, codecs, retries, and a local gateway.
Repository
| Field | Value |
|---|---|
| Repository | github.com/looprig/inference |
| Version | v0.12.0 |
| GitHub | looprig/inference |
Description
Invoke and stream model requests through explicit descriptors, codecs, retries, and a local gateway.
Where it fits
Inference is useful on its own when a Go application needs provider-neutral model requests, streaming, codecs, retries, routing, or a local model gateway. Within Looprig, it supplies the model boundary for Harness, Eval, Tools, and Workflows. Inference moves model data; it does not own agent sessions or provider credential catalogs.