[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#1064101: RFP: whisper.cpp -- automatic speech recognition



Package: wnpp
Severity: wishlist
X-Debbugs-Cc: debian-ai@lists.debian.org

* Package name    : whisper.cpp
  Version         : 1.5.4
  Upstream Author : Georgi Gerganov
* URL             : https://github.com/ggerganov/whisper.cpp
* License         : MIT
  Programming Lang: C++
  Description     : Automatic speech recogniztion, port of OpenAI's Whisper model in C/C++

High-performance inference of OpenAI's Whisper automatic speech
recognition (ASR) model:

 * Plain C/C++ implementation without dependencies
 * Apple Silicon first-class citizen - optimized via ARM NEON, Accelerate framework, Metal and Core ML
 * AVX intrinsics support for x86 architectures
 * VSX intrinsics support for POWER architectures
 * Mixed F16 / F32 precision
 * 4-bit and 5-bit integer quantization support
 * Zero memory allocations at runtime
 * Support for CPU-only inference
 * Efficient GPU support for NVIDIA
 * Partial OpenCL GPU support via CLBlast
 * OpenVINO Support
 * C-style API

This package could be a good fit for maintainence by the Debian Deep
Learning Team.  It might need to go into non-free, as it to work need a
machine learning model trained on unknown content and without any easy
way to be reproduced using non-proprietary data sets.

This is an alternative implementation to the one requested in
<URL: https://bugs.debian.org/1034091 >.

-- 
Happy hacking
Petter Reinholdtsen


Reply to: