00:00:00 Intro.
00:01:12 Difference between RK3588 and RK3576 (CPU and GPU).
00:02:15 NPU performance 6TOPS 3NPU or 6TOPS 2 NPU, who will win?
00:03:37 Price and power performance
00:04:26 Meckotronics R57 Debian installation
00:05:44 RKLLM (rkllmruntime)? How to set up LLM for RockChip? (RK3588, RK3576)
00:07:30 Setting up environment: host machine
00:07:55 Run the export script
00:08:25 Running RKLLM
00:08:41 Flusk API wrapper
00:10:00 Supported LLM models for RK3576 and RK3588
00:11:10 Useful transformers, Whisper support
00:12:10 My impressions


My LinkedIn   / maltsevanton  
My Telegram channel https://t.me/CVML_team
email: [email protected]
Twitter   / serious_wk  

The board I used as RK3576 https://www.mekotronics.com/hpd86.html https://membercenter.madeinchina.co...
   • Mekotronics R57 vs R58 with Geekbench...   Comparision test about CPU and GPU
https://github.com/airockchip/rknnll... main library from RockChip
https://github.com/Pelochus/ezrknnllm A nice fork from the official one