Product Guide
Linux PC
Industrial Control
LLM
Real-Time AI Voice Assistant
AtomS3R-M12 Volcengine Kit
Offline Voice Recognition
Zigbee
IoT Measuring Instruments
VAMeter
IoT Cloud
AWS IoT Core
Ethernet Camera
PoECAM
Wi-Fi Camera
Unit CamS3
AI Camera
LoRa & LoRaWAN
Motor Control
Network
Restore Factory Firmware
DIP Switch Usage Guide
Module GPS v2.0
Module GNSS
Module ExtPort For Core2
Module LoRa868 V1.2
Model List
This endpoint is used to retrieve the list of model services currently installed on the device.
Model Installation and Viewing
- Before use, please refer to the corresponding device’s software update tutorial to add and update the M5Stack apt repository information and index.
- View the list of available llm deb packages. Packages named in the
llm-model-nameformat are model packages.
apt list | grep llm-model-- Use the
aptcommand to install packages as needed, for example, install thellm-model-qwen2.5-0.5b-p256-ax630cpackage. Note: models occupy significant space; it is recommended to install as needed.
apt install llm-model-qwen2.5-0.5b-p256-ax630cViewing Available Models
You can query the list of models currently available on the device from a PC via the OpenAI API. Before running the program, modify the IP part of the base_url below to the actual IP address of the device.
from openai import OpenAI
client = OpenAI(
api_key="sk-",
base_url="http://192.168.20.186:8000/v1"
)
client.models.list()
print(client.models.list())Response Example
SyncPage[Model](data=[
Model(id='melotts_zh-cn', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='qwen2.5-0.5B-prefill-20e', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='sherpa-ncnn-streaming-zipformer-20M-2023-02-17', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='sherpa-ncnn-streaming-zipformer-zh-14M-2023-02-23', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='single_speaker_english_fast', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='single_speaker_fast', created=0, object='model', owned_by='user', permission=[], root=''),
Model(id='qwen2.5-0.5B-p256-ax630c', created=0, object='model', owned_by='user', permission=[], root='')
],
object='list')