Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Tengine is a lite, high performance, modular inference engine for embedded device

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

Run Time for AIE and FPGA based platforms

An MLIR-based toolchain for AMD AI Engine-enabled devices.

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Efficient Inference of Transformer models

Allo Accelerator Design and Programming Framework (PLDI'24)

Universal Virtualization Management Platform 可扩展的通用虚拟化管理平台，支持 Proxmox VE / LXD (GPU) / Incus (GPU) / Docker / Podman / Containerd / Qemu / Kubevirt

Persist and reuse KV Cache to speedup your LLM.

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

西北工业大学本科毕业设计/硕士博士学位论文 LaTeX 模板 （2026）

Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs

No-code CLI designed for accelerating ONNX workflows

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series