On-device, real-time multimodal AI with features similar to GPT-Live
-
Updated
Aug 3, 2026 - Python
On-device, real-time multimodal AI with features similar to GPT-Live
The most advanced, fully offline client-side AI suite on Android today.
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.
Turn your Android phone into an OpenAI-compatible LLM inference server — Fully local, private and Open Source
Run ml models with tflite & litert & executorch runtimes on edge devices
Swift package for running LiteRT-LM models on iOS. Wraps Google's C API in a clean, async/await Swift interface.
🚀 Zero-backend, 100% client-side local AI assistant starter template. Powered by WebGPU and Google LiteRT-LM (Gemma 4). Offline-first PWA with multi-language TTS, customizable personas, and GitHub Pages deployment in 5 minutes.
Rust bindings for LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
Edge Agent Lab is an Android testing platform for evaluating small language model (SLM) agents directly on mobile devices.
Run LLM inference in an Android app with llama.cpp, ExecuTorch, LiteRT, ONNX, and more.
Cross-platform LiteRT-LM bindings for Unity & .NET apps.
Curated resources for Google's LiteRT on-device ML stack — runtime, LiteRT-LM, conversion tooling, models, bindings, and engineering notes. Weekly-updated by an automated radar.
Unofficial Swift SDK for Google's LiteRT-LM — run Gemma 4 on-device with text, vision, audio, and tool calling. CPU + GPU (Metal). iOS 17+ / macOS 14+.
On-device LLM client for Android. Fork of Google AI Edge Gallery
Experimental local-first Android AI agent built with Kotlin and Jetpack Compose, featuring on-device Gemma models, policy-controlled tool calling, and safe Android automation.
Shongjog — Offline Bangla Multi-Hazard Emergency Companion Powered by Gemma 4. Emergency AI for 12 disaster types. Gemma 4 on-device works offline, gets better online, and meshes phone-to-phone.
An AI agent you build, not just prompt. Local-first Android agent with on-device inference (LiteRT-LM), pipelines you assemble yourself, MCP tool calling, and your confirmation before any risky action.
Ash — offline survival assistant for iOS. Gemma 4 E2B/E4B fully on-device (text · image · voice) with RAG-grounded answers over 56 emergency-response packs. Built for the Kaggle Gemma 4 Good Hackathon.
Add a description, image, and links to the litert-lm topic page so that developers can more easily learn about it.
To associate your repository with the litert-lm topic, visit your repo's landing page and select "manage topics."