Overview ======== .. image:: images/module_llm_kit.png :alt: Example image :width: 800px :align: center Description ----------- Module LLM Kit is a smart modular kit focused on offline AI inference and data communication interface applications. It integrates the Module LLM and Module13.2 LLM Mate modules to meet the offline AI inference and data interaction requirements across various scenarios. Module LLM is an integrated offline large language model (LLM) inference module designed specifically for terminal devices that require efficient and intelligent interaction. Whether for smart home applications, voice assistants, or industrial control, Module LLM delivers a smooth and natural AI experience without relying on the cloud, ensuring privacy, security, and stability. Features -------- - **Offline LLM Inference**: Module LLM is designed for offline inference of large language models, enabling efficient and intelligent interactions without relying on cloud services. - **High Performance**: The module is equipped with a powerful AX630C processor, capable of handling complex AI tasks with ease. - **Low Power Consumption**: The module is designed to operate efficiently, consuming minimal power while delivering high performance. Specifications -------------- +-----------------------+----------------------------------------------------------------------------+ | Specification | Parameter | +=======================+============================================================================+ | Processor SoC | AX630C@Dual Cortex A53 1.2 GHz, MAX.12.8 TOPS @INT4, 3.2 TOPS @INT8 | +-----------------------+----------------------------------------------------------------------------+ | Memory | 4GB LPDDR4 (1GB system memory + 3GB dedicated to hardware acceleration) | +-----------------------+----------------------------------------------------------------------------+ | Storage | 32GB eMMC5.1 | +-----------------------+----------------------------------------------------------------------------+ | Communication | Serial communication, default baud rate 115200@8N1 (adjustable) | +-----------------------+----------------------------------------------------------------------------+ | Microphone | MSM421A | +-----------------------+----------------------------------------------------------------------------+ | Audio Driver | AW8737 | +-----------------------+----------------------------------------------------------------------------+ | Speaker | 8Ω@1W, size: 2014 cavity speaker | +-----------------------+----------------------------------------------------------------------------+ | RGB LED | 3x RGB LED@2020, driven by LP5562 (status indicator) | +-----------------------+----------------------------------------------------------------------------+ | Power Consumption | No load: 5V@0.5W, Full load: 5V@1.5W | +-----------------------+----------------------------------------------------------------------------+ | Button | Used to enter firmware download mode | +-----------------------+----------------------------------------------------------------------------+ | Conversion Chip | CH340N | +-----------------------+----------------------------------------------------------------------------+ | Ethernet | RJ45 interface with onboard network transformer (11FB-05NL SOP-16) | +-----------------------+----------------------------------------------------------------------------+ | Serial Interfaces | FPC-8P interface, Type-C interface, RJ45 interface | +-----------------------+----------------------------------------------------------------------------+ | DIY Expansion | HT3.96*9P solder pad | +-----------------------+----------------------------------------------------------------------------+ | Operating Temp | 0-40°C | +-----------------------+----------------------------------------------------------------------------+