Sign Up For Our Newsletter
Receive our latest updates about our products & promotions.
Note: All products are tax-inclusive.
Module LLM is an integrated offline Large Language Model (LLM) inference module designed for terminal devices that require efficient and intelligent interaction. Whether for smart homes, voice assistants, or industrial control, Module LLM provides a smooth and natural AI experience without relying on the cloud, ensuring privacy and stability. Integrated with the StackFlow framework and Arduino/UiFlow libraries, smart features can be easily implemented with just a few lines of code.
Powered by the advanced AX630C SoC processor, it integrates a 3.2 TOPs high-efficiency NPU with native support for Transformer models, handling complex AI tasks with ease. Equipped with 4GB LPDDR4 memory (1GB available for user applications, 3GB dedicated to hardware acceleration) and 32GB eMMC storage, it supports parallel loading and sequential inference of multiple models, ensuring smooth multitasking. The main chip is manufactured using TSMC’s 12nm process, with a runtime power consumption of approximately 1.5W, making it highly efficient and suitable for long-term operation.
It features a built-in microphone, speaker, TF storage card, USB OTG, and RGB status light, meeting diverse application needs with support for voice interaction and data transfer. The module offers flexible expansion: the onboard SD card slot supports cold/hot firmware upgrades, and the UART communication interface simplifies connection and debugging, ensuring continuous optimization and expansion of module functionality. The USB port supports master-slave auto-switching, serving as both a debugging port and allowing connection to additional USB devices like cameras. Users can purchase the LLM debugging kit to add a 100 Mbps Ethernet port and kernel serial port, using it as an SBC.
The module is compatible with multiple models and comes pre-installed with the Qwen2.5-0.5B language model. It features KWS (wake word), ASR (speech recognition), LLM (large language model), and TTS (text-to-speech) functionalities, with support for standalone calls or pipeline automatic transfer for convenient development. Future support includes Qwen2.5-1.5B, Llama3.2-1B, and InternVL2-1B models, allowing hot model updates to keep up with community trends and accommodate various complex AI tasks. Vision recognition capabilities include support for CLIP, YoloWorld, and future updates for DepthAnything, SegmentAnything, and other advanced models to enhance intelligent recognition and analysis.
Plug and play with M5 hosts, Module LLM offers an easy-to-use AI interaction experience. Users can quickly integrate it into existing smart devices without complex settings, enabling smart functionality and improving device intelligence. This product is suitable for offline voice assistants, text-to-speech conversion, smart home control, interactive robots, and more.
Specification | Parameter |
---|---|
Processor SoC | AX630C@Dual Cortex A53 1.2 GHz MAX.12.8 TOPS @INT4 and 3.2 TOPS @INT8 |
Memory | 4GB LPDDR4 (1GB system memory + 3GB dedicated for hardware acceleration) |
Storage | 32GB eMMC5.1 |
Communication | Serial communication default baud rate 115200@8N1 (adjustable) |
Microphone | MSM421A |
Audio Driver | AW8737 |
Speaker | 8Ω@1W, Size:2014 cavity speaker |
Built-in Units | KWS (wake word), ASR (speech recognition), LLM (large language model), TTS (text-to-speech) |
RGB Light | 3x RGB LED@2020 driven by LP5562 (status indication) |
Power | Idle: 5V@0.5W, Full load: 5V@1.5W |
Button | For entering download mode for firmware upgrade |
Upgrade Port | SD card / Type-C port |
Working Temp | 0-40°C |
Product Size | 54*54*13mm |
Packaging Size | 133*95*16mm |
Product Weight | 17.4g |
Packaging Weight | 32.0g |
Distributors are not eligible for free shipping.
We offer competitively priced shipping services via Deutsche Post, DHL, YunExpress, and 4PX, with tracking to ensure your products are delivered safely and promptly.
Faster shipping times to Western and Eastern Europe apply only to products marked as "Product Inventory Location: Germany" on the product page. If the product is not labeled with this location, it will ship from our Chinese warehouse following the corresponding shipping schedule above.
Whether shipped from Germany or China, we cover all import duties and taxes, ensuring that you receive your package without any additional costs or hassles with customs.
Please verify the inventory location on the product page before placing your order to confirm delivery timeframes. For any questions or further assistance, feel free to contact us!
Our products are stored in both our Shenzhen and German warehouses to provide more flexible logistics solutions tailored to different regions and customer needs. On each product's description page, we indicate the specific warehouse location to help you better plan your purchase and delivery schedule.
For products stored in our warehouse in Germany, we use either Deutsche Post or DHL for shipping, depending on the size of the package. Logistics within Germany are very efficient, with an estimated delivery time of 2-4 business days, ensuring you receive your order quickly and conveniently.
Products shipped from our Chinese warehouse are handled by YunExpress. Given the complexities of international shipping, the estimated delivery time for these packages is around 10 business days, though this may vary slightly due to customs processes or other uncontrollable factors.
To ensure that your order is delivered within your desired timeframe, we recommend reviewing the warehouse information provided on the product pages before placing your order and selecting the appropriate shipping option. If you have any questions or need further assistance, please don't hesitate to contact our customer support team—we are here to help you!
Please note that it may take 1-2 working days for Deutsche Post, DHL, YunExpress, and 4PX services to update the status from 'Shipped' to 'Traceable'.
Effective Date: March 25, 2024
OpenELAB guarantees to provide accurate descriptions and high-quality products. If you encounter any problems with any executed purchase order, please notify OpenELAB within 60 days from the date of shipment.Receive our latest updates about our products & promotions.
Thanks for subscribing!
This email has been registered!