Welcome to ModuleLLM’s documentation!

ModuleLLM Module LLM is an integrated offline large language model (LLM) inference module, designed for terminal devices that require efficient and intelligent interaction. Whether in smart homes, voice assistants, or industrial control, Module LLM can provide you with a smooth and natural AI experience without relying on the cloud, ensuring privacy, security, and stability.

Check out the Module LLM Kit for further information.

Note

This project is under active development.

Contents:

• Overview
  • Description
  • Features
  • Specifications
• Quickstart
  • Establish a connection with ModuleLLM
  • Software Upgrade
  • SD Card Upgrade
  • Appendix
• Software
  • Dependency package
  • Feature module
• Models
  • Reasoning models
  • Flagship chat models
  • Multimodal models
  • Text-to-speech
  • Transcription
  • Keyword spotting
  • Voice activity detection
  • Automatic Speech Recognition
  • Vision
  • Model Pages
• Python
  • Examples
• Arduino
  • Overview
  • Environment Setup
  • Examples
  • API reference
• UiFlow
  • Examples
  • API reference