Overview

Example image

Description

Module LLM Kit is a smart modular kit focused on offline AI inference and data communication interface applications. It integrates the Module LLM and Module13.2 LLM Mate modules to meet the offline AI inference and data interaction requirements across various scenarios.

Module LLM is an integrated offline large language model (LLM) inference module designed specifically for terminal devices that require efficient and intelligent interaction. Whether for smart home applications, voice assistants, or industrial control, Module LLM delivers a smooth and natural AI experience without relying on the cloud, ensuring privacy, security, and stability.

Features

  • Offline LLM Inference: Module LLM is designed for offline inference of large language models, enabling efficient and intelligent interactions without relying on cloud services.

  • High Performance: The module is equipped with a powerful AX630C processor, capable of handling complex AI tasks with ease.

  • Low Power Consumption: The module is designed to operate efficiently, consuming minimal power while delivering high performance.

Specifications

Specification

Parameter

Processor SoC

AX630C@Dual Cortex A53 1.2 GHz, MAX.12.8 TOPS @INT4, 3.2 TOPS @INT8

Memory

4GB LPDDR4 (1GB system memory + 3GB dedicated to hardware acceleration)

Storage

32GB eMMC5.1

Communication

Serial communication, default baud rate 115200@8N1 (adjustable)

Microphone

MSM421A

Audio Driver

AW8737

Speaker

8Ω@1W, size: 2014 cavity speaker

RGB LED

3x RGB LED@2020, driven by LP5562 (status indicator)

Power Consumption

No load: 5V@0.5W, Full load: 5V@1.5W

Button

Used to enter firmware download mode

Conversion Chip

CH340N

Ethernet

RJ45 interface with onboard network transformer (11FB-05NL SOP-16)

Serial Interfaces

FPC-8P interface, Type-C interface, RJ45 interface

DIY Expansion

HT3.96*9P solder pad

Operating Temp

0-40°C