v0.8.4-BETA // TOKEN_PROXY

Stop burning API credits on redundant code.

Litos sits between your IDE and the LLM as a proxy layer. It prunes stale context, deduplicates files, and caches repeat queries before the request ever reaches your provider.

LITOS_USAGE_MONITOR.sh
[SESSION_ACTIVE]$1.42 saved
Pruned_Tokens
42,801
Cache_Hits
12
Tokens per request-34% avg
AgentsContinueClineRoo Code
ProvidersAnthropicOpenAIOllama
Optimization Protocols

Three ways Litos cuts the bill.

01
-40%
Avg. context overhead

Context Rolling

Automatically ejects stale conversation history and irrelevant file chunks so your agent stays inside the efficient part of the context window.

02
0.0ms
Hash check latency

File Deduplication

Hashes every file in the session and replaces redundant uploads with reference pointers. The same index.ts stops arriving four times per turn.

03
Instant
Repeat query response

Pattern Caching

Common utility queries and linting fixes are cached locally. Repeat requests return instantly without another API call.

Proxy Layer

One hop between your agent and the LLM.

01

Intercept

Litos reads each outgoing request from Continue, Cline, or Roo before it leaves your machine.

02

Optimize

Stale context is rolled, duplicate files are deduplicated, and cached patterns are resolved locally.

03

Forward

Only the lean, relevant payload reaches Anthropic, OpenAI, or your local Ollama endpoint.

Real-Time Visibility

See what your agent is spending.

The Litos Chrome extension surfaces per-request token counts, cost estimates, and which optimizations fired — directly in your browser.

chrome-extension://litos/monitor
Litos browser extension popup showing token usage savings, a bar chart, and recent optimized API calls

“Know exactly how much every ‘refactor this component’ request costs before you hit the usage limit.”

Ready to optimize?

Free for local models. Individual license for cloud providers. No tracking, no telemetry, no bloat.

  • No account required
  • Local-first cache
  • Open source core