CVT, a Computer Vision Toolkit.
-
Updated
Aug 24, 2022 - C
CVT, a Computer Vision Toolkit.
Winner solution of mobile AI (CVPRW 2021).
A header-only neural network library for microcontrollers, with partial bare-metal & native-os support.
Breeze TTS 2 nodes for ComfyUI: voice clone, voice design, and voice direction with bilingual (EN/ZH) speech, inline vocal events, INT8 ConvRot quantized builds, and full ComfyUI / AIMDO dynamic-VRAM integration.
FrostNet: Towards Quantization-Aware Network Architecture Search
Quantization Aware Training
ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.
ATtiny85 arduino example, running an RNN MNIST model via the (internal) 512-Byte EEPROM with ~95% accuracy
DEEPX NPU compiler (DX-COM): convert ONNX models into optimized .dxnn binaries with INT8 quantization for DEEPX NPUs such as DX-M1. Part of the DXNN SDK
将端上模型部署过程中,常见的问题以及解决办法记录并汇总,希望能给其他人带来一点帮助。
FireRedTTS3 for ComfyUI: multilingual zero-shot voice cloning, voice design, speech editing, Whisper transcripts, AIMDO DynamicVRAM, with bf16 / INT8 compatibility
Silicon-proven INT8 systolic NPU (8×8 MAC array) taped out on SkyWater 130nm via LibreLane. Features a custom 32-bit ISA, UART–APB host interface, and fused streaming datapath. Validated on chest X-ray pneumonia detection. Silicon Sprint 2026 — AUC.
Reverse-engineering notes on tscmoo's Pluto StarCraft: BW AI (binary-only release)
A tool-calling layer, not a language model — your schemas in, validated calls out, at 48M parameters. Malformed JSON, invented parameter names, and undeclared tools are structurally unreachable on any catalog. Adapt it to your own catalog; 11 negative results included.
Garuda: CVXIF coprocessor optimizing batch-1 attention microkernels with 7.5-9× lower p99 latency. RISC-V INT8 MAC accelerator for transformer inference.
Optimizing MobileNetV2 and YOLOv8n for real-time CPU inference with OpenVINO and INT8 quantization (NNCF), benchmarked on real CCTV footage including a model-limitation case study.
Tooling for dataset captioning, model merging and quantizing.
C# api wrapper for llm-inference chatllm.cpp
VB.NET api wrapper for llm-inference chatllm.cpp
To associate your repository with the int8-quantization topic, visit your repo's landing page and select "manage topics."