Tag: cost-optimization

Showing 1-3 of 3

Jun 08, 20267 min readAgent PlaybookIntermediate180 min build

How Viktor uses prompt caching and byte-stable prefixes to cut agent-thread costs

Viktor turns repeated thread history into cheap cache reads with byte-stable prefixes, SDK tools, append-only logs and in-cache compaction — a 40-step thread fell from $11.35 to $2.07.

prompt-caching agent-threads cost-optimization llm-ops token-economics

+3 more

NewsUnited Kingdom

Open

May 02, 20266 min readAgent PlaybookIntermediate

AWS Strands Agents: an agent-to-tool design that cut LLM token use by ~96%

An AWS Strands Agents design moved extraction, summarization and caching out of prompts into deterministic tools, cutting measured LLM token use by ~96% and lowering costs, privacy risk.

AWS Strands agents token-usage cost-optimization

+3 more

LLM-ops privacy tooling

NewsFrance

Open

Mar 23, 20267 min readTooling Deep DiveBeginner

AIPriceCompare — Compare public AI model API pricing by media type and request count

See pricing for dozens of public LLMs and multimodal models on one page. Use Prompt Media Type and Count to quickly produce a reproducible shortlist before billing tests.

ai pricing cost-optimization tools models

+1 more

api