Skip to main content

ICE FAQ

How does ICE handle sessions longer than the model's context window?

ICE decouples session history from the model's physical context limit. It stores the full interaction history in a 3-tier ledger (Hot-Cache → Semantic Ledger → Cold Archive) and retrieves only the most relevant fragments for each request, assembling them into the prompt before forwarding to the model.

How does ICE prevent context degradation in long conversations?

Retrieval results are ranked and placed at the highest-attention positions in the prompt — the prefix and suffix. Lower-relevance content is compressed or omitted. The model always sees the most important context first, regardless of total session length.

Is Row-Level Security (RLS) mandatory?

RLS is mandatory for multi-tenant Enterprise deployments. It is enforced at the PostgreSQL database layer using the X-User-Id and X-Session-Id headers. One user cannot access another's session data — this is enforced at the database, not in application code.

Can ICE run in air-gapped environments?

Yes. ICE runs fully on-premise with no external network access. Configure it with your own PostgreSQL and Redis instances. No outbound connectivity required.

What happens if PostgreSQL or Redis goes down?

ICE enters fallback mode — it bypasses context injection and routes the raw prompt directly to the upstream LLM. Your API stays up. Context augmentation resumes automatically once the backing services recover.

Can I use ICE with my existing OpenAI SDK?

Yes. ICE is OpenAI-compatible. Point base_url at your ICE instance and add the two memory headers (X-Session-Id, X-User-Id). Everything else in your existing code stays the same. See API Reference.

What happens if I send a request without X-Session-Id?

ICE operates statelessly — no context is retrieved or stored. The request is forwarded to the upstream model as-is. Memory only activates when X-Session-Id is present.

How do I upgrade from Community to Pro?

Update ICE_LICENSE_JWT with your Pro license key and restart the engine.

Where do I report issues?

Email [email protected] with subject TECHNICAL_ISSUE: ICE.