logo elektroda
logo elektroda
X
logo elektroda

MAiX DOCK set: RISC-V, python and image analysis, tests, launch

TechEkspert 8340 6

TL;DR

  • MAiX DOCK is a $19.90 SiPEED M1W RISC-V kit built around the K210 dual-core CPU, with camera, TFT display, microphone, WiFi antenna and microSD support.
  • It runs MaixPy after firmware updates, with Python control over UART/USB and an IDE for running scripts, autostart apps and serial console experiments.
  • Tests covered live camera display at about 15FPS, microphone FFT examples, face detection, QR decoding and predefined 20-class image recognition.
  • The board drew about 1.4W, but the software and documentation are still immature, and creating a custom recognition model was not clarified.
Generated by the language model.
ADVERTISEMENT
Treść została przetłumaczona polish » english Zobacz oryginalną wersję tematu
📢 Listen (AI):
  • MAiX DOCK set: RISC-V, python and image analysis, tests, launch
    Architecture RISC-V has already discussed on elektroda.pl, a set SiPEED MAiX DOCK in the price of $ 19.90, it is based on the SiPEED M1W module containing the K210 dual-core CPU in RISC-V architecture, KPU (support for artificial neural networks) and WiFi 2.4GHz connectivity (previous version M1 needed an external WiFi module, e.g. ESP8266). The set includes a M1W board, microphone, LED, connector for micro SD card, camera, TFT display, WiFi antenna and micro USB to USB C adapter. Numerous interfaces are available on goldpin connectors that can be soldered in PCB. The board has an audio signal output and PAM8403 amplifier. USB allows you to power the module and UART communication (CH340).

    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    The flexible tapes connecting the display and the camera are quite delicate, it is worth to take care of attaching a heavy display so as not to damage the flexible bus during the tests.

    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    When we power the device message "Welcome to MAiXPy" appears on the display:
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    Next we can enter on manufacturer's website https://www.sipeed.com Unfortunately, many links lead to a non-existent page and we get a 404 error ...

    More information can be found at seeedstudio.com
    https://www.seeedstudio.com/Artificial-Intell...1/Sipeed-M1w-dock-suit-M1w-dock-2-4-inch-LCD- OV2640-K210-Dev-Board-1st-RV64-Al-board-for-Edge-Computing-p-3207.html
    and in the description of MAiXPy .

    At the beginning, we need update the module software as described on the page:
    https://maixpy.sipeed.com/en/get_started/upgrade_firmware.html#update-maixpy-firmware

    We can download updater:
    https://github.com/sipeed/kflash_gui/releases
    and firmware:
    https://github.com/sipeed/MaixPy/releases
    I chose this firmware:
    maixpy_v0.3.2_full.bin
    and face recognition model to load at address 0x300000:
    face_model_at_0x300000.kfpkg

    When can open UART console in eg PuTTY (in the device manager we will find the number of the virtual COM port created after connecting the module). Communication speed: 115200 .

    When we restart the board, the messages will confirm the firmware version:
    Code: Text
    Log in, to see the code


    We can execute code in python line by line, or using ctrl-E ctrl-D to run block of code.

    Github resources: https://github.com/sipeed/MaixPy_scripts first let's put image from camera on the display:

    Code: Python
    Log in, to see the code


    During the program execution, the module draw ~ 1.4W.
    To obtain a good focus, objects should be moved away from the miniature camera to min. 20cm.
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    IDE is available for the module to facilitate further experiments:
    http://dl.sipeed.com/MAIX/MaixPy/ide/v0.2.2/

    We must choose our board model:
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    In the lower left corner you can enable or disable the connection with the module, and stop or run the code in python.
    In the screenshot below you can see the experiments with the code displaying the camera image, refresh ~ 15FPS:
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch[/quote]

    Let's test more sample code:
    https://github.com/sipeed/MaixPy_scripts

    Example with FFT form signal provided form microphone on PCBs:
    https://github.com/sipeed/MaixPy_scripts/tree/master/hardware

    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    Face detection works, however with different effectiveness
    https://github.com/sipeed/MaixPy_scripts/tree/master/machine_vision

    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    Similarly, QR codes, but slowly but correctly:
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    Through IDE, we can easily add file to "autostart", so that after the module reset the selected code will be launched automatically.

    It's worth taking a look at the example of network communication:
    https://github.com/sipeed/MaixPy_scripts/blob/master/network/demo_send_pic.py
    and the server in the python receiving the pictures:
    https://github.com/sipeed/MaixPy_scripts/blob/master/tools_on_PC/network/pic_server.py
    After connecting a microSD card, examples with reading and writing multimedia will be useful:
    https://github.com/sipeed/MaixPy_scripts/tree/master/multimedia

    I didn't check WiFi communication and microSD card support, recognizing objects in the image was much more interesting :)

    There is an initial (which may contain many errors) example with recognition in the image of predefined 20 objects (airplane, bicycle, bird, boat, bottle, bus, car, cat, cow, table, dog, horse, motor, person, potted plant, sheep , sofa, train, monitor / TV).

    The file is available here:
    http://blog.sipeed.com/p/677.html
    we can upload to the module:
    file maixpy_20class.bin
    and
    20class.kmodel at the address 0x500000
    then open the serial console via eg putty and using ctrl-e ctrl-d we place and run the 20class.py code

    The effects of running code:
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch MAiX DOCK set: RISC-V, python and image analysis, tests, launch MAiX DOCK set: RISC-V, python and image analysis, tests, launch MAiX DOCK set: RISC-V, python and image analysis, tests, launch

    One of the possible applications is the construction of a device for the youngest, which will recognize the images shown to the camera.
    Both photos and drawings can be recognized. There is a chance that after a few attempts you will be able to draw an object that will be correctly recognized by the device.

    At the end a short film showing the recognition of various objects and even "ten-second" drawings with a marker on a piece of paper ;)




    The manufacturer has prepared support for Arduino:
    https://maixduino.sipeed.com/en/get_started/install.html

    It seems that the module's software is at the development stage. Python allows for a fairly high-level exploration of the platform and quick preparation of test codes. It is easy to start rehearsals and experiments with sound and image processing, but for example I could not determine how to prepare my own model for recognizing a specific object. Low price, low power consumption, WiFi connectivity and a supported high-level programming language are the advantages of the MAiX DOCK module in a set with display and camera. The development of software and documentation as well as the development of the community is a chance to popularize this platform.

    What ideas do you have to use the MAiX DOCK set with the SiPEED M1W module?

    Cool? Ranking DIY
    About Author
    TechEkspert
    Editor
    Offline 
    TechEkspert wrote 7029 posts with rating 5452, helped 16 times. Been with us since 2014 year.
  • ADVERTISEMENT
  • #2 18018427
    rafels
    Level 25  
    Posts: 717
    Help: 69
    Rate: 166
    Board Language: polish
    Great price.

    As for models, there are tools available for converting models, including compilations from tensorflow lite models
    https://github.com/sipeed/Maix_Toolbox

    Specifically, the tflite2kmodel.sh script

    To make it work, you have to download the nnc applications with the get_nncase.sh script
  • ADVERTISEMENT
  • #3 18018665
    gulson
    System Administrator
    Posts: 29226
    Help: 148
    Rate: 5979
    Board Language: polish
    I have a second such module with a display and a webcam, I can send a person who would like to throw on the forum some interesting application (write an article), in return the person leaves himself a module and gets an SD card for holiday photos :)

    Outdated, the module is already flying to Hetia's user :)
  • ADVERTISEMENT
  • #4 18019563
    TechEkspert
    Editor
    Posts: 7029
    Help: 16
    Rate: 5452
    Board Language: polish
    Congratulations @Hetii

    The microSD card will also be useful for MAiX DOCK :)
    MAiX DOCK set: RISC-V, python and image analysis, tests, launch
  • ADVERTISEMENT
  • #5 18029810
    Hetii
    Level 17  
    Posts: 518
    Help: 4
    Rate: 420
    Board Language: polish
    TechEkspert wrote:
    Congratulations @Hetii


    Thank you ;)

    The module has arrived and is just breaking the first ice cream with it.

    Unfortunately, something is not hallo, namely the first of the usb cables did not exist enumeration of the device, after replacing the wire, I see that it detects it as / dev / ttyUSB0.

    Then in the IDE gives connect, the communication window appears with the device, and the red logo disappears on the display and a white background appears for a fraction of a second, just like the uC was reset.
    In IDE, however, this window appears and disappears, and so on and on.

    I checked the active hub of usb 2.0 and the computer directly (with three different wires), with the same effect.

    voltage:
    5v => 4.93v
    3.3v => 3.34v
    1.8v => 1.80v

    OS: Ubuntu-mate 18.10
  • #6 18029819
    TechEkspert
    Editor
    Posts: 7029
    Help: 16
    Rate: 5452
    Board Language: polish
    Hey,
    you run under Linux, it will be a good test on another OS.

    Have you tried outside of IDE to communicate via / dev / ttyUSB0 at 115200? We'll see then what is the firmware version, maybe you need to update?
  • #7 18029842
    Hetii
    Level 17  
    Posts: 518
    Help: 4
    Rate: 420
    Board Language: polish
    I just just updated the firmware according to your description.

    There is improvement, the module has connected and I have a preview from the webcam.

    It's true that the IDE came out the first time and I had to copy the facial recognition model twice, but finally I was able to run this example, and there is progress ;)
📢 Listen (AI):

Topic summary

✨ The MAiX DOCK set, priced at $19.90, features the SiPEED M1W module with a K210 dual-core CPU based on RISC-V architecture, supporting KPU for neural networks and 2.4GHz WiFi connectivity. The kit includes a M1W board, microphone, LED, micro SD card connector, camera, TFT display, WiFi antenna, and a micro USB to USB C adapter. Users have discussed model conversion tools for TensorFlow Lite models and shared experiences with device connectivity issues, firmware updates, and successful webcam integration. The importance of using compatible USB cables and testing on different operating systems was highlighted.
Generated by the language model.

FAQ

TL;DR: MAiX DOCK shows 15 FPS live video while drawing only 1.4 W; “Python allows for a fairly high-level exploration” [Elektroda, TechEkspert, post #18017857] Flash v0.3.2 firmware, talk over 115200 baud, and edge-AI demos work within minutes.

Why it matters: The board packs RISC-V AI acceleration into a US$20 kit that prototypes vision projects without heavyweight tooling.

Quick Facts

• Price: US $19.90 kit incl. LCD + camera [Elektroda, TechEkspert, post #18017857] • CPU: Kendryte K210 dual-core 64-bit RISC-V, approx. 400 MHz (SiPEED product page) • Typical power draw: 1.4 W during Python camera loop [Elektroda, TechEkspert, post #18017857] • Live preview rate: ~15 FPS at QVGA [Elektroda, TechEkspert, post #18017857] • Default UART: USB-CDC /dev/ttyUSB0 @ 115200 bps [Elektroda, TechEkspert, post #18017857]

What does the MAiX DOCK kit include?

You get the M1W module, 2.4-inch TFT LCD, OV2640 camera, microphone, LED, Wi-Fi antenna, micro-SD socket, PAM8403 audio amp, gold-pin headers and a USB-C adapter [Elektroda, TechEkspert, post #18017857]

How do I upgrade the firmware?

  1. Download kflash_gui and the latest maixpy*.bin [Elektroda, TechEkspert, post #18017857]
  2. Hold BOOT, press RESET, then flash at 0x000000.
  3. Optionally flash models (e.g., face_model.kfpkg at 0x300000) and reboot. The process takes about 30 s over USB-UART.

Which port and settings let me access the Python REPL?

Open /dev/ttyUSB0 (Windows: the new COM port) at 115200 bps, 8-N-1. Press RESET; the banner prints firmware version and build date [Elektroda, TechEkspert, post #18017857]

Why does the board sometimes fail to enumerate over USB?

A faulty or power-only USB cable can block enumeration. Replacing the cable and reflashing firmware restored stable connectivity for another user [Elektroda, Hetii, #18029810; #18029842].

How do I show the live camera image on the LCD in Python?

Use the four-line snippet:
python
import sensor, image, lcd
lcd.init(); sensor.reset()
sensor.set_pixformat(sensor.RGB565)
sensor.set_framesize(sensor.QVGA)
sensor.run(1)
while True:
lcd.display(sensor.snapshot())
It streams around 15 FPS [Elektroda, TechEkspert, post #18017857]

Can I convert TensorFlow Lite models for K210?

Yes. Run the tflite2kmodel.sh script from Maix_Toolbox after downloading NNCase with get_nncase.sh. The tool outputs a *.kmodel that MaixPy loads at a chosen flash offset [Elektroda, rafels, post #18018427]

Does MAiX DOCK support Wi-Fi and micro-SD cards?

The M1W adds onboard 2.4 GHz Wi-Fi; MaixPy offers socket APIs. A micro-SD slot supports FAT32 read/write for images, audio and models [Elektroda, TechEkspert, post #18017857]

How can I send captured pictures to a PC?

Use demo_send_pic.py on the board and pic_server.py on your PC. The board encodes JPEG and streams it over Wi-Fi TCP [Elektroda, TechEkspert, post #18017857]

Can I train my own object-detection model?

You can; convert a TensorFlow-Lite or ONNX model with NNCase, then flash it as a .kmodel. Custom anchors and mean/std settings must match during inference. “Model tuning still needs polish,” admits SiPEED docs (MAiXPy Wiki).

Is Arduino support available?

Yes. Install the Maixduino core via the board manager, then program in C++ with familiar Arduino APIs [maixduino.sipeed.com].

What voltages should I read on the rails?

Expect 5 V ≈ 4.9 V, 3.3 V ≈ 3.34 V and 1.8 V ≈ 1.80 V; these values were confirmed on a working board [Elektroda, Hetii, post #18029810]

IDE keeps connecting and disconnecting—how to fix?

Flash current firmware, use a data-capable USB cable, and avoid high-power hubs. This solved the loop-reset issue for one user [Elektroda, Hetii, post #18029842]
Generated by the language model.
ADVERTISEMENT