Tag: on-device

Showing 1-3 of 3

Aug 04, 20269 min readAgent PlaybookIntermediate90 min build

On-device agents with LFM2.5–2.6B: tool calling, performance baselines, and rollout checklist

Guide to run LFM2.5-2.6B agents on laptops, phones, and small servers. Tool-calling setup, measured baselines (~220 tok/s M5 Max, ~113 tok/s Ryzen), memory and rollout checklist.

LFM2.5 LFM2.6B LiquidAI local-agents edge-inference

+3 more

TutorialsUnited Kingdom

Open

Aug 02, 20267 min readAgent PlaybookIntermediate45 min build

Recreate the web-ai-sdk Playground to prototype browser-hosted AI agents

Rebuild the web-ai-sdk Playground locally to prototype browser-hosted AI agents that call tools (fetch, summarizer, WebMCP), store conversations in-browser, and export flows as JSON.

web-ai-sdk playground browser-agents on-device tools

+3 more

privacy tutorial prompt-engineering

TutorialsUnited States

Open

Jul 09, 20267 min readTooling Deep DiveIntermediate180 min build

Ved-Test: Running a Self-hosted Offline Voice Assistant on a 12GB-class Consumer GPU

Step-by-step guide to Ved-Test on GitHub for a self-hosted, offline voice assistant. Walk through a 2-4 hour POC, per-endpoint setup, costs and multi-room plans.

ved voice-assistant self-hosted offline-ai multimodal

+3 more

on-device llm home-automation