openbuddy-llama3.2-1b-v23.1-131k

Introduction

OpenBuddy is a powerful open multilingual chatbot model aimed at global users, emphasizing conversational AI and seamless multilingual support for English, Chinese, and other languages.

Built upon Tii’s Falcon model and Facebook’s LLaMA model, OpenBuddy is fine-tuned to include an extended vocabulary, additional common characters, and enhanced token embeddings. By leveraging these improvements and multi-turn dialogue datasets, OpenBuddy offers a robust model capable of answering questions and performing translation tasks across various languages.

Available NPU Models

Base Model

openbuddy-llama3.2-1B-ax630c

The Base Model providing a 128 context window and a maximum output of 1,024 tokens.

Support Platforms: LLM630 Compute Kit, Module LLM, and Module LLM Kit

  • 128 context window

  • 1,024 max output tokens

  • ttft 891.02ms

  • avg-token/s 4.52

Install
apt install llm-model-openbuddy-llama3.2-1b-ax630c

Manual installation: Click here to download llm-model-openbuddy-llama3.2-1b-ax630c