LiteRT-LM
google-ai-edge/LiteRT-LM
Google's open-source framework allowing you to run large language models smoothly on local devices like phones and watches without internet.
AI Summary
What This Project Does
Google's official tool to help developers run large models on phones, computers, and even watches.
What Problems It Solves
Solves issues like models needing internet, privacy leaks, and slow response, allowing smart conversation offline.
Who It's For
Programmers building local AI apps, or enthusiasts wanting to run models on private devices.
Typical Use Cases
Using AI assistant in Chrome browser, checking info offline on smartwatch, or developing local privacy-protecting chatbots.
Key Strengths & Highlights
Google-backed, adapts to various hardware (GPU/NPU), supports multi-modality (seeing/hearing), and tool function calling.
Getting Started Requirements
Command-line tool available for direct try, but deep development needs C++ and mobile dev basics.
Purpose
Suitable for local AI developers or privacy-conscious users with hardware acceleration. Not for those who just want simple chat without setup.
Category
Project Info
- Primary Language
- C++
- Default Branch
- main
- License
- Apache-2.0
- Homepage
- —
- Created
- Apr 14, 2025
- Last Commit
- yesterday
- Last Push
- yesterday
- Indexed
- Apr 19, 2026