GitHub - boquila/boquilahub: AIs for nature

3 min read Original article ↗

Cross-platform app to run AI models to monitor and protect nature. Locally, no cloud.

readme

Features

  • Cross-platform.
  • GUI and CLI tool
  • Run AIs for computer vision, locally
  • Process image, video and live feed
  • Deploy and consume REST APIs, with maximum efficiency. Powered by axum

Installation

Download the latest binaries from releases

AIs

You can load any .bq model. You can find them on our website.

List of Platforms

Platform Production ready
Windows ✅
Linux ✅
Android On the way
Web On the way
MacOS Not soon
iOS Not soon

List of Runtimes

Runtime Description Requirements Available?
CPU Your average CPU Having a CPU ✅
NVIDIA CUDA CUDA execution provider for NVIDIA GPUs (Maxwell 7xx and above) CUDA v12.8 + cuDNN 9.7 ✅
Remote BoquilaHUB A BoquilaHUB session in your network with a deployed REST API Having the URL ✅
NVIDIA TensorRT TensorRT execution provider for NVIDIA GPUs (GeForce 9xx series and above) 🚧 🚀 Soon
AMD ROCm ROCm execution provider for AMD GPUs 🚧 🚀 Soon
AMD MIGraphX MIGraphX execution provider for AMD GPUs 🚧 🚀 Soon
AMD Vitis AI Vitis AI execution provider for Xilinx FPGA devices 🚧 🚀 Soon
Intel OpenVINO OpenVINO execution provider for Intel Core CPUs (6th gen and above) 🚧 🚀 Soon
Intel oneDNN Intel oneDNN execution provider for x86/x64 targets 🚧 🚀 Soon
Microsoft DirectML DirectML execution provider for Windows x86/x64 targets with dedicated GPUs 🚧 🚀 Soon
Microsoft Azure Azure AI execution provider for cloud-based inference 🚧 🚀 Soon
Qualcomm QNN Qualcomm AI Engine Direct SDK execution provider for Qualcomm chipsets 🚧 🚀 Soon
Apple CoreML CoreML execution provider for Apple devices 🚧 🚀 Soon
XNNPACK XNNPACK execution provider for optimized inference on ARM and x86 devices 🚧 🚀 Soon
Huawei CANN Huawei CANN execution provider for Huawei Ascend AI processors 🚧 🚀 Soon
Android NNAPI Android NNAPI execution provider for mobile devices with NNAPI support 🚧 🚀 Soon
Apache TVM Apache TVM execution provider for multiple backends 🚧 🚀 Soon
Arm ACL Arm Compute Library (ACL) execution provider for Arm devices 🚧 🚀 Soon
ArmNN ArmNN execution provider for ARM-based devices 🚧 🚀 Soon
Rockchip RKNPU Rockchip RKNPU execution provider for Rockchip NPUs 🚧 🚀 Soon

How to compile

If you want to compile from source just have to

git clone https://github.com/boquila/boquilahub/
cd boquilahub
cargo build --release

Probably instead of cloning from main, you should prefer to get the source code from a tagged version

Dependencies

FFmpeg

This project requires FFmpeg to be installed and available in your system PATH.

Windows:

curl -L -o ffmpeg.7z https://github.com/GyanD/codexffmpeg/releases/download/7.1.1/ffmpeg-7.1.1-full_build-shared.7z
7z x ffmpeg.7z -offmpeg -y

set FFMPEG_DIR=%cd%\ffmpeg\ffmpeg-7.1.1-full_build-shared
set PATH=%FFMPEG_DIR%\bin;%PATH%

Linux:

sudo apt-get update
sudo apt-get install -y \
  ffmpeg \
  libavutil-dev \
  libavcodec-dev \
  libavformat-dev \
  libswscale-dev \
  libavdevice-dev \
  libavfilter-dev \
  libswresample-dev