GitHub - hongbo-miao/hongbomiao.com: A personal research and development (R&D) lab that facilitates the sharing of knowledge.

👩‍🚀 Introduction

OSS Insight repository performance statistics

A personal research and development (R&D) lab that facilitates the sharing of knowledge.

🚀 Architecture

The diagram illustrates the repository's architecture, which is considered overly complex. It is essential to thoroughly understand the tradeoffs associated with it before onboarding any technology into your project.

Note

The diagram here may take a moment to load. Please wait patiently.

🧱 Tech Stack

Web

React - Web framework
Vite - JavaScript build tool and development server
Zustand - State management
TanStack Query - Hooks for fetching, caching and updating asynchronous data
TanStack Router - Router
shadcn/ui - UI component library
Tailwind CSS - Utility-first CSS framework
Radix Primitives - Low-level, unstyled, accessible UI primitives
Vitest - Unit testing, snapshot testing
React Testing Library - React component testing
Storybook - Visual testing
- Chromatic - Storybook reviewing
Cypress - End-to-end testing
Lighthouse CI - Performance, accessibility, search engine optimization (SEO), progressive web app (PWA) analysis
Sentry - Error tracking
Report URI - Security reporting
Google Tag Manager - Tag management
Google Analytics - Web analytics
FullStory - Experience analytics, session replay, heatmaps
Namecheap - Domain
Cloudflare - DNS, DDoS protection, CDN
HTTP/3 Check - HTTP/3 checking
hstspreload.org - HSTS checking
Mozilla HTTP Observatory - Security monitoring
UptimeRobot - Uptime monitoring

Mobile

Mobile - iOS

Tuist - Xcode project generation and management tool
SwiftUI - UI framework
MLX Swift LM - Large language model (LLM) and vision language model (VLM) fine-tuning and inference framework using MLX optimized for GPU (Metal)
kokoro-ios - Text-to-speech (TTS) framework using MLX optimized for GPU (Metal)
FluidAudio - Real-time automatic speech recognition (ASR), speaker diarization, voice activity detector (VAD), and text-to-speech (TTS) framework using Core ML optimized exclusively for NPU (Apple Neural Engine (ANE))
WhisperKit - Automatic speech recognition (ASR) framework using Core ML optimized for both NPU (Apple Neural Engine (ANE)) and GPU (Metal)
Core ML Stable Diffusion - Text-to-image (T2I) framework using Core ML optimized for both NPU (Apple Neural Engine (ANE)) and GPU (Metal)
swift-transformers - Transformers-like API with tokenization and Hugging Face Hub integration
Core ML Tools - Core ML model conversion, editing, and validation for iOS/macOS
XCTest - Unit testing, performance testing
Slather - Code coverage report generation
Mint - Package management

Mobile - Android

AndroidX - Android Jetpack
JUnit - Unit testing, instrumented testing

Mobile - React Native

Expo - Platform for making universal native apps
React Native - Mobile application framework
UI Kitten - UI library
React Native Testing Library - React Native component testing

Desktop

Desktop - Qt

Qt Quick - Cross-platform application development framework
QML - Qt modeling language

API Server

API Server - Rust

axum - Web framework
- Axum Test - End-to-end testing
WTransport - WebTransport
Tokio - Asynchronous runtime
- tokio-stream - Stream utilities and adapters
tower - Service trait and middleware library
- tower-http - HTTP middleware and utilities (compression, CORS, timeout, trace)
- tower-governor - Rate limiting
Serde - Serialization and deserialization framework
futures-rs - Foundational traits and utilities for async programming (Future, Stream, Sink)
OnceCell - Lazy initialization of static values and global state
async-graphql - GraphQL (query, mutation, subscription, depth limit, complexity limit)
SQLx - Async SQL toolkit
Rayon - Data parallelism
PyO3 - Rust bindings to the Python interpreter
ort - ONNX Runtime
opencv-rust - OpenCV bindings
flate2 - DEFLATE, Gzip, and Zlib compression and decompression library
ndarray - N-dimensional array library
nalgebra - Linear algebra library
async-openai - OpenAI API library
Hound - WAV file encoding and decoding
flacenc-rs - FLAC encoding
webrtc-vad - WebRTC Voice Activity Detector (VAD)
FFmpeg Sidecar - Iterator-based FFmpeg wrapper
Anyhow - Error handling
Tracing - Tracing
- tracing-subscriber - Utilities for implementing and composing tracing subscribers
dotenvy - Environment variables loading
utoipa - OpenAPI document generation
- utoipa-swagger-ui - Swagger UI integration

API Server - Go

Gin - Web framework
gRPC - Remote procedure call (RPC) framework
graphql-go - GraphQL
jwt-go - JSON Web Token (JWT)
gin-contrib/cors - Cross-Origin Resource Sharing (CORS)
opa - Open Policy Agent
pgx - PostgreSQL driver
dgo - Dgraph client
valkey-go - Valkey client
AWS SDK for Go - Amazon Web Services (AWS) SDK
Resty - HTTP client
Squirrel - SQL query builder
apm-agent-go - Application performance monitoring (APM) agent
OpenTelemetry Go - OpenTelemetry
Prometheus Go - Prometheus
Testify - Unit testing
GoDotEnv - Environment variables loading
jsonparser - JSON parser
zerolog - Logging

API Server - Python

FastAPI - Web framework
PydanticAI - Large language model (LLM) agent framework
openai - OpenAI API library
Mem0 - Memory layer
Sentence Transformers - Sentence embedding
LanceDB - Embedded vector database
pydantic - Data validation
HTTPX - HTTP client
asyncpg - PostgreSQL client library
pytest - Unit testing
Uvicorn - Asynchronous server gateway interface (ASGI) server
Poe the Poet - Task runner
uv - Python package management

API Server - Node.js

SWC - JavaScript compiler
Express - Web framework
GraphQL.js, graphql-http - GraphQL
- graphql-ws, graphql-subscriptions - GraphQL subscription
- graphql-upload - GraphQL upload
- graphql-shield - GraphQL permissions
- graphql-depth-limit - GraphQL depth limit
- graphql-query-complexity - GraphQL complexity limit
DataLoader - Batching and caching
Knex.js - SQL query builder
node-postgres - PostgreSQL client library
ioredis - Redis client
rate-limiter-flexible - Rate limiting
expressjs/cors - Cross-Origin Resource Sharing (CORS)
jsonwebtoken, express-jwt - JSON Web Token (JWT)
bcrypt - Password hashing
Helmet - HTTP header Content-Security-Policy, Referrer-Policy, Strict-Transport-Security, X-Content-Type-Options, X-DNS-Prefetch-Control, X-Download-Options, X-Frame-Options, X-Permitted-Cross-Domain-Policies, X-XSS-Protection
Report To - HTTP header Report-To
Network Error Logging - HTTP header NEL
express-request-id - HTTP header X-Request-ID
response-time - HTTP header X-Response-Time
connect-timeout - Request timeout
request-ip - IP address retrieving
Terminus - Health check and graceful shutdown
pino - Logging
dotenv-flow - Environment variables loading
Jest - Unit testing
Stryker - Mutation testing
SuperTest - HTTP testing
autocannon - HTTP benchmarking
Clinic.js - Performance profiling
Node.js - JavaScript runtime
npm - JavaScript package management

Load Testing

Grafana k6 - Load testing
Locust - Load testing

Cloud Native

Sealed Secrets - Kubernetes secret encrypting
CoreDNS - DNS server
ExternalDNS - Kubernetes services and Ingresses with external DNS providers synchronizing
cert-manager - Kubernetes X.509 certificate management
Harbor - Container image registry
Velero - Kubernetes backup and disaster recovery
CSI for S3 - Container Storage Interface (CSI) driver for S3 and S3-compatible storage
Hasura - GraphQL Engine
- hasura-metric-adapter - Hasura GraphQL Engine metric adapter
Cilium - eBPF-based networking, observability, security
- Hubble - Network and security observability platform
Linkerd - Service mesh
Caddy - Web server, reverse proxy, load balancer
Traefik - Web server, reverse proxy, load balancer
nginx - Web server, reverse proxy, load balancer
Metrics Server - Kubernetes metrics
Telegraf - Plugin-driven server agent
Docker - Container
Skaffold - Continuous development for Kubernetes applications
Kustomize - Template-free customization of Kubernetes manifests
Multipass - Virtual machine management
Cloudflare Tunnel - Tunneling
Vertical Pod Autoscaler - Kubernetes vertical pod autoscaler
Karpenter - Kubernetes node autoscaler
KEDA - Kubernetes event-driven autoscaler
NVIDIA GPU Operator - Kubernetes operator for GPU driver and device plugin management
RKE2 - Lightweight Kubernetes
K3s - Lightweight Kubernetes
containerd - Container runtime
Kubernetes - Container-orchestration system

Monitoring

Grafana - Observability and data visualization
- Grafana Alloy - OpenTelemetry collector
- Grafana Beyla - eBPF-based auto-instrumentation tool
- Grafana Loki - Log aggregation system
- Grafana Mimir - Prometheus metrics storage
- Grafana Tempo - Distributed tracing backend
- Grafana Pyroscope - Continuous profiling platform
- Grafana k6 - Load testing
Vector - Log collector
Fluent Bit - Log collector
Prometheus - Time-series database
- Thanos - Long-term storage for Prometheus
- Grafana Mimir - Long-term storage for Prometheus
- Prometheus NATS Exporter - NATS metrics exporter
- Prometheus Postgres Exporter - PostgreSQL metrics exporter
- Prometheus Prefect Exporter - Prefect metrics exporter
OpenTelemetry - Observability framework
Jaeger - Distributed tracing system
Pixie - Kubernetes application observability tool
Netdata - Distributed monitoring platform
Gatus - Health dashboard
Elastic APM - Application performance monitoring
Kibana - Elasticsearch visualization

Data

Data Ingestion

Airbyte - Data integration

Data Orchestration

Prefect - Orchestration platform
Apache Airflow - Orchestration platform
Temporal - Orchestration platform

Data Processing

CocoIndex - AI-native data transformation framework
Pathway - Real-time data processing framework
Apache Spark - Data processing framework
- Spark Connect - Decoupled client-server architecture for remote Spark connectivity
- Spark ML - Spark machine learning
- pyspark - Spark API library
- Delight - Spark UI and history server
Apache Sedona - Spatial data processing framework
Apache Flink - Data processing framework
- flink-streaming-java - Flink
- flink-connector-twitter - Flink Twitter connector
- flink-connector-jdbc - Flink JDBC Connector
- flink-connector-redis - Flink Redis connector
NATS - Edge and cloud native messaging system
- nats-py - NATS Python client
- async-nats - NATS Rust client
Apache Pulsar - Distributed event streaming and messaging platform
Apache Kafka - Distributed event streaming platform
- Client
  - librdkafka - Kafka C/C++ client
    - libserdes - AVRO serialization and deserialization
  - confluent-kafka - Kafka Python client
  - rust-rdkafka - Kafka Rust client
- Schema registry
  - Confluent Schema Registry - Schema Registry
  - Apicurio Registry - Schema Registry
- Replication
  - MirrorMaker - Data replicating
- Connector
  - Debezium - Distributed change-data-capture (CDC) platform
  - debezium-connector-postgres - PostgreSQL CDC source connector
  - confluentinc-kafka-connect-jdbc - JDBC source and sink connector
  - confluentinc-kafka-connect-s3 - Amazon S3 Sink Connector
  - snowflake-kafka-connector - Snowflake Sink Connector
  - kafka-connect-elasticsearch - Elasticsearch sink connector
  - http-connector-for-apache-kafka - HTTP sink connector
  - kafka-connect-avro-converter - Confluent Avro converter
  - apicurio-registry-distro-connect-converter - Apicurio Avro converter
- Operator
  - Strimzi Kafka Operator - Kubernetes operator for deploying and managing Kafka clusters
- Management tool
  - Redpanda Console - Kafka management
  - AKHQ - Kafka management
  - UI for Apache Kafka - Kafka management
  - topicctl - Kafka topic management

Data Transformation

dbt - Data transformation

Data Format

Apache Parquet - On-disk columnar format
Apache Arrow - In-memory columnar format
Vortex - Arrow-compatible columnar format
Lance - Columnar file format for machine learning
Protocol Buffers (Protobuf) - Data serialization format
BLF - Binary log format
GeoJSON - Geospatial data interchange format
HDF5 - Hierarchical data format
MF4 - Measurement data format (MDF)
TRC - PEAK-System trace capture

Database, Data Warehouse, Data Lakehouse

SQLite - Embedded relational SQL database
- Turso - Edge-hosted distributed database
DuckDB - Embedded analytical SQL database
PostgreSQL - Object-relational database
- Patroni - PostgreSQL high-availability (HA) template
- Postgres Operator - PostgreSQL cluster provisioning
- pgAdmin - PostgreSQL management tool
- Extension
  - pg_graphql - GraphQL
MySQL - Relational database
- MariaDB - Fork of MySQL
Hydra - Column-oriented SQL database
ClickHouse - Column-oriented SQL database
YugabyteDB - Distributed SQL database
TimescaleDB - Time-series SQL database
Prometheus - Time-series database
InfluxDB - Distributed time-series database
VictoriaMetrics - Distributed time-series database
Loki - Log aggregation system
RocksDB - Embedded key-value store
Valkey - Distributed in-memory key-value store
Apache Cassandra - Distributed wide-column NoSQL database
Faiss - Vector search and similarity library
LanceDB - Embedded vector database
Qdrant - Distributed vector database
Chroma - Embedded and distributed vector database
Dgraph - Distributed graph database
Elasticsearch - Distributed document-oriented search engine
RustFS - Distributed, high-performance object storage system
Apache ZooKeeper - Distributed coordination system
Apache Hadoop - Software utility collection
- Apache Hadoop HDFS (Distributed File System) - Distributed file system
- Apache Hadoop YARN (Yet Another Resource Negotiator) - Resource management and job scheduling framework
- Apache Hadoop MapReduce - Data processing framework
Apache Hive - Distributed data warehousing and SQL-like query language system built on top of Apache Hadoop
Trino - Distributed SQL query engine
Delta Lake - Data lakehouse
Apache Iceberg - Data lakehouse
Apache Doris - High-performance analytical database
StarRocks - High-performance analytical database
Snowflake - Data warehouse
Odoo - Enterprise resource planning (ERP) and customer relationship management (CRM)
golang-migrate/migrate - Database migrations

Data Catalog

AWS Glue Data Catalog - Serverless, centralized metadata repository
Nessie - Apache Iceberg transactional data catalog
Lakekeeper - Apache Iceberg REST catalog
Apache Polaris - Apache Iceberg REST catalog
Nimtable - Apache Iceberg observability and control plane (table inspection, compaction, and optimization)

Data Visualization

Plotly - Interactive scientific, engineering, and business data visualization
Grafana - Monitoring, observability, and real-time data visualization
Metabase - Business intelligence (BI) data visualization
Apache Superset - Business intelligence (BI) data visualization
Tableau - Business intelligence (BI) data visualization
IADS - Flight test data visualization
Rerun - Multimodal data visualization for computer vision and robotics

Data Analytics

NumPy - Array computation library
- Numba - NumPy-aware Just-in-time (JIT) compiler
- CuPy - GPU-accelerated array computation library
pandas - Data analysis library
- GeoPandas - Spatial data library
- AWS SDK for pandas - pandas integration with AWS services
- cuDF - GPU-powered DataFrame library
- Polars - High-performance DataFrame library
- Modin - Distributed DataFrame library
- Daft - Distributed DataFrame library
Narwhals - Compatibility layer between DataFrame libraries
NetworkX - Network analysis library
marimo - Reactive Python notebook
JupyterLab - Web-based interactive computing platform
- nb-clean - Jupyter notebook cleaning
Databricks - Data analytics platform
Palantir - Data analytics platform

Data Quality

Data drift
- Covariate shift
- Concept drift
- Univariate drift
  - Jensen-Shannon distance - categorical and continuous
  - Hellinger - categorical and continuous
  - Wasserstein - continuous
  - Kolmogorov-Smirnov - continuous
  - L-infinity - categorical
  - Chi2 - categorical
- Multivariate drift
Performance estimation
- Direct loss estimation (DLE) - Regression
  - Mean absolute error (MAE)
  - Mean absolute percentage error (MAPE)
  - Mean squared error (MSE)
  - Root mean squared error (RMSE)
  - Mean squared logarithmic error (MSLE)
  - Root mean squared logarithmic error (RMSLE)
- Confidence-based performance estimation (CBPE)- Classification
  - Confusion matrix
  - ROC AUC
  - Accuracy
  - Precision
  - Recall
  - F1 score
Regression analysis
- Linear regression
- Polynomial regression
- Lasso regression (L1 regularization)
- Ridge regression (L2 regularization)
- Elastic net (L1 + L2 regularization)
- Logistic regression
- Bayesian regression
- Stepwise regression
- Robust regression
- Ecological regression
- Quantile regression
Ensemble learning
- Bagging
- Boosting
  - Adaptive boosting
    - AdaBoost
  - Gradient boosting
    - XGBoost
    - LightGBM
    - CatBoost
- Stacking

Data Application

PyGWalker - Data exploration
Gradio - Machine learning application building
Streamlit - Data application building
Dash - Data application and dashboard building

Data Transport

Arrow Flight - High-performance data transport framework
ZeroMQ - High-performance asynchronous messaging library
- NetMQ - C# implementation of ZeroMQ
- zmq.rs - Rust implementation of ZeroMQ
RTI Connext DDS - Data distribution service (DDS) middleware framework
Dust DDS - Data distribution service (DDS) middleware framework

Evolutionary Algorithm (EA)

Genetic Algorithm (GA) - Optimization algorithm inspired by natural selection, using mutation, crossover, and selection

Machine Learning (ML)

scikit-learn - Machine learning library
- cuML - GPU-accelerated machine learning library
PyTorch - Machine learning
- torchvision - PyTorch computer vision models and utilities
- PyTorch Geometric - PyTorch geometric deep learning extension
- TorchServe - PyTorch models serving
Flax - Neural network for JAX
- Optax - Gradient processing and optimization for JAX
Lightning - Deep Learning framework
NeuralForecast - Neural forecasting
AutoGluon - Automated machine learning (AutoML) library
OGB - Open graph benchmark
Optuna - Hyperparameter optimization framework
hydra-zen - Pythonic configuration management built on Hydra
DVC - Data version control
Feast - Feature store
Metaflow - Machine learning orchestration
Kubeflow - Machine learning orchestration, experiment tracking, model registry, model serving
TensorBoard - Experiment tracking and visualization
MLflow - Experiment tracking, model registry, model deployment
Weights & Biases - Experiment tracking, model registry
NVIDIA Data Loading Library (DALI) - GPU-accelerated data loading and preprocessing pipeline
NVIDIA Triton Inference Server - Inference server
NVIDIA Modulus - Physics-informed machine learning framework

Large Language Model (LLM)

Data Annotation
- Label Studio - Data annotation
Data Crawling
- Crawl4AI - Web data scraping, crawling
- Firecrawl - Web data scraping, crawling, extraction
Data Extraction
- Document Data Extraction
  - MinerU - Document data extraction
  - olmOCR - Document data extraction
  - Docling - Document data extraction
  - pypdf - PDF manipulation
- Named Entity Recognition (NER)
  - BERT - General-purpose language model (fine-tuned for named entity recognition)
  - GLiNER - Named entity recognition
Tokenization
- Byte-Pair Encoding (BPE) - Subword tokenization
Embedding
- Model2Vec - Fast static text embeddings distilled from Sentence Transformers
Model Architecture
- Transformer
  - Dense Transformer - Standard transformer where all parameters (attention + FFN layers) are active for every token using full self-attention across the sequence
  - Mixture of Experts (MoE) - Sparse transformer that routes each token to top-k expert sub-networks, activating only a fraction of total parameters to scale model capacity efficiently
- State Space Model (SSM)
  - Mamba 2 - State space model architecture for efficient sequence modeling with linear-time complexity
Large Language Model (LLM) Pre-Training
- Training Paradigm
  - Causal Language Model (CLM)
    - Qwen3 - Decoder-only transformer model for autoregressive text generation
    - MiniMax M2.1 - Decoder-only sparse Mixture-of-Experts (MoE) model for autoregressive text generation
  - Masked Language Model (MLM)
    - ModernBERT - BERT-style encoder with Rotary Positional Embedding (RoPE), Flash Attention, GeGLU activations, and a context length of 8,192 tokens.
    - NeoBERT - BERT-style encoder with Rotary Positional Embedding (RoPE), RMSNorm, SwiGLU activations, and a context length of 4,096 tokens.
- Training Optimization
  - Automatic Mixed Precision - Mixed precision FP16/FP32 training
  - Accelerate - Hugging Face library for distributed training across CPU, multi-GPU, and TPU with mixed precision (FP16/BFloat16/FP8) and DeepSpeed, Fully Sharded Data Parallel (FSDP), Megatron-LM integration
  - DeepSpeed - Deep learning optimization library for easy, efficient, and effective distributed training and inference
    - Zero Redundancy Optimizer (ZeRO) - Memory optimization through partitioning optimizer states, gradients, and parameters
    - ZeRO-Infinity - CPU/Non-Volatile Memory Express (NVMe) offloading for training models beyond GPU memory limits
    - 3D Parallelism - Combined data, pipeline, and tensor parallelism strategy
    - Ulysses Sequence Parallelism - Sequence splitting for efficient long-context processing
    - DeepSpeed-MoE - Optimized training and inference for Mixture of Experts (MoE) models
Large Language Model (LLM) Post-Training
- Fine-Tuning
  - Supervised Fine-Tuning (SFT) - Training technique that updates all model parameters using labeled instruction-response pairs
  - Direct Preference Optimization (DPO) - Alignment technique that directly optimizes language models on human preference data without requiring a separate reward model
  - Proximal Policy Optimization (PPO) - Reinforcement learning algorithm that uses a clipped surrogate objective to enable stable policy updates while preventing destructively large parameter changes
  - Group Relative Policy Optimization (GRPO) - Reinforcement learning algorithm that estimates baselines from group scores instead of critic models, reducing memory usage while maintaining training effectiveness
  - Low-Rank Adaptation (LoRA) - Parameter-efficient fine-tuning method that trains low-rank decomposition matrices instead of full model weights
  - Quantized Low-Rank Adaptation (QLoRA) - Memory-efficient fine-tuning method that combines 4-bit quantization with Low-Rank Adaptation (LoRA) to enable training large models on limited GPU memory
  - PEFT - Hugging Face library implementing parameter-efficient fine-tuning methods including Low-Rank Adaptation (LoRA), prefix tuning, and adapters
  - TRL - Hugging Face library for training large language models with reinforcement learning including Supervised Fine-Tuning (SFT), Proximal Policy Optimization (PPO), and Direct Preference Optimization (DPO)
  - Unsloth - Efficient large language model (LLM) fine-tuning on single GPU via custom Triton kernels
  - torchtune - PyTorch-native, modular distributed large language model (LLM) fine-tuning
  - Axolotl - YAML-driven distributed large language model (LLM) fine-tuning
  - LLaMA-Factory - Distributed large language model (LLM) fine-tuning with optional web interface
  - SWIFT - Distributed large language model (LLM) fine-tuning with support for multiple algorithms and optimization techniques
  - Tinker - Managed distributed training API with low-level control
- Quantization
  - torchao - PyTorch-native quantization and sparsification
Large Language Model (LLM) Inference
- Ollama - Local large language model (LLM) inference
- LM Studio - Local large language model (LLM) inference
- Transformers - Model-definition framework for machine learning models
  - Optimum - Hardware-acceleration toolkit for optimizing model training and inference across specific backends (e.g., ONNX Runtime, Intel, AMD, AWS Trainium)
- llama.cpp - High-performance large language model (LLM) inference in C/C++
- MLX LM - Large language model (LLM) inference for Apple silicon
- vLLM - High-throughput large language model (LLM) inference
  - vLLM Production Stack - Kubernetes-native reference system for cluster-wide vLLM deployment, request routing, and observability
  - LMCache - Distributed key-value (KV) cache layer that enables cache sharing and offloading across instances to reduce Time to First Token (TTFT)
- SGLang - High-throughput large language model (LLM) and vision language model (VLM) inference
- KV Caching - Memory optimization technique caching key/value pairs from self-attention to accelerate auto-regressive decoding
- Speculative Decoding - Acceleration technique using draft models
Large Language Model (LLM) Evaluation
- DeepEval - Large language model (LLM) evaluation framework
Large Language Model (LLM) Gateway
- LiteLLM - Large language model (LLM) gateway
Large Language Model (LLM) Application
- PydanticAI - Large language model (LLM) agent framework
- LangGraph - Large language model (LLM) workflow library
- LlamaIndex - Large language model (LLM) data framework
AI Chat Interface
- Open WebUI - AI chat interface
  - Open WebUI Pipelines - OpenAI API plugin framework
Vector Database
- Faiss - Vector search and similarity library
- LanceDB - Embedded vector database
- Qdrant - Distributed vector database
- Chroma - Distributed vector database
Agent Communication Protocol
- Model Context Protocol (MCP)
- Agent Communication Protocol (ACP)
- Agent2Agent Protocol (A2A)

Small Language Model (SLM)

Small Language Model (SLM)
- Gemma 3 270M - Small language model (SLM)

Vision Language Model (VLM)

Vision Language Model (VLM)
- Qwen3-VL - Vision language model (VLM)

Convolutional Neural Network (CNN)

Convolutional Neural Network (CNN) - A deep learning architecture that uses learnable convolutional filters to automatically detect spatial hierarchies and local patterns in data, primarily used for image recognition, computer vision, and spatial data processing

Graph Neural Network (GNN)

Graph Neural Network (GNN) - A neural network architecture designed to process graph-structured data by iteratively aggregating information from neighboring nodes, enabling learning on non-Euclidean domains like social networks, molecules, and knowledge graphs

Liquid Neural Network (LNN)

Liquid Neural Network (LNN) - A continuous-time recurrent neural architecture with adaptive, dynamic behavior inspired by biological neurons, optimized for robust time-series modeling, control, and robotics

Multimodal Model

Embedding
- OpenCLIP - Multimodal embedding model for images and text
- ImageBind - Multimodal embedding model for images, text, audio, video, depth, thermal, and inertial measurement units (IMUs)
Multimodal Model
- Qwen3-Omni - Omni multimodal model with text, audio, image, video understanding and real-time speech generation
- Vision-Language-Action (VLA) Model
  - OpenVLA - Vision-language-action model for robotic manipulation that processes visual observations and language instructions to generate robot actions, fine-tuned from prism-dinosiglip-224px (DINOv2 ViT-L/14 and ViT-SO400M-14-SigLIP vision backbones, LLaMA 2 language model)
  - openpi - Flow-based and autoregressive vision-language-action models (π₀, π₀-FAST, π₀.₅) pre-trained on 10k+ hours of robot data for robotic manipulation across various platforms including ALOHA, DROID, and custom robots
  - Alpamayo 1 - Reasoning-based vision-language-action (VLA) model

World Foundation Model (WFM)

NVIDIA Cosmos - Platform for physical AI featuring generative world foundation models (WFMs), guardrails, and accelerated data processing pipelines

Generative Model

Flow Matching - Continuous-time generative modeling technique that learns a vector field to transport a simple distribution to a complex data distribution
torchdiffeq - PyTorch differentiable ordinary differential equation (ODE) solvers
Neural Ordinary Differential Equation (Neural ODE) - Neural network architecture that models continuous-time dynamics by parameterizing the derivative of hidden states as a neural network, solved using ordinary differential equation (ODE) solvers
Variational Autoencoder (VAE) - Latent-variable generative modeling technique that learns to map data to a probabilistic distribution and reconstruct it via an encoder-decoder architecture
Diffusion Model - Continuous-time generative modeling technique that learns to reverse a multi-step noising process to reconstruct data from Gaussian noise
Stable Diffusion - Latent diffusion model (LDM) architecture designed for high-resolution text-to-image (T2I) generation by performing the diffusion process in a compressed latent space
Diffusers - Diffusion models for image, video, and audio generation
ComfyUI - Node-based interface for diffusion model workflows

Reinforcement Learning (RL)

Gymnasium - Reinforcement learning environment toolkit
Q-Learning - Model-free reinforcement learning algorithm for learning optimal actions
Actor-Critic Algorithm - Policy gradient method combining actor (policy) and critic (value) networks

Computer Vision

OpenCV - Computer vision library
supervision - Computer vision library
Ultralytics YOLOv12 - Object detection model
Open3D - 3D data processing
PyVista - 3D plotting and mesh analysis
Visualization Toolkit (VTK) - Image processing, 3D graphics, volume rendering and visualization
GStreamer - Pipeline-based multimedia framework
AnyUp - Universal feature upsampling
Vision Transformer (ViT)
- DINOv3 - Self-supervised vision transformer (ViT) model

Audio

Live Coding
- Strudel - JavaScript port of Tidal Cycles for live coding dynamic music patterns
Voice Activity Detection (VAD)
- WebRTC VAD - Voice activity detection
- RNNoise VAD - Voice activity detection
- Silero VAD - Voice activity detection
Speaker Diarization
- Diart - Real-time speaker diarization
- Streaming Sortformer Diarizer 4spk v2.1 - Real-time speaker diarization model for up to 4 speakers using a streaming Transformer-based architecture
Audio Signal Analysis
- Librosa - Audio signal analysis
Automatic Speech Recognition (ASR)
- Automatic Speech Recognition (ASR) Inference
  - Faster Whisper - Fast Whisper inference using CTranslate2
  - WhisperX - Whisper-based transcription with word-level timestamps and speaker diarization
  - Speaches - OpenAI-compatible inference server for streaming transcription, translation, and speech generation
  - WhisperKit - On-device Whisper for Apple
  - whisper.cpp - High-performance Whisper inference in C/C++
  - NVIDIA NeMo - Conversational AI toolkit for building, training, and fine-tuning speech AI models (automatic speech recognition (ASR), text-to-speech (TTS)) and large language models (LLMs)
- Automatic Speech Recognition (ASR) Evaluation
  - JiWER - Automatic speech recognition evaluation, including word error rate (WER), match error rate (MER), word information lost (WIL), word information preserved (WIP), and character error rate (CER)

Video

Media Streaming Server
- MediaMTX - Media streaming server
- Icecast - Media streaming server

Computing

Compiler Infrastructure

LLVM - Compiler infrastructure

Parallel Computing

CUDA - Parallel computing language
Taichi - Parallel computing language
Triton - Parallel computing language

High-Performance Computing (HPC)

Julia - High-performance dynamic programming language
JAX - High-performance numerical computing
AWS ParallelCluster - High performance computing (HPC) cluster management
- NICE DCV - Remote display
AWS Batch - Batch computing
Open MPI - High-performance computing (HPC) library
Slurm - Workload management
Volcano - Kubernetes batch scheduling system

Cloud Computing

Amazon EC2 - Cloud computing
Ray - Distributed computing framework
SkyPilot - Sky computing

Scientific Computing

SunPy - Solar physics data analysis

Quantum Computing

Qiskit - Quantum computing

Cloud

Cloud Platform

Nebius
- Object Storage - Object storage
- Managed Service for Kubernetes - Kubernetes
Amazon Web Services
- Amazon Athena - Serverless query service
- Amazon Bedrock - Generative AI model service
- Amazon CloudTrail - Data governance, data compliance, data auditing
- Amazon DynamoDB - NoSQL database
- Amazon EBS - Block storage
- Amazon EC2 - Cloud computing
- Amazon ECR - Container registry
- Amazon EKS - Kubernetes
- Amazon EMR - Big data platform
- Amazon EventBridge - Serverless event bus
- Amazon MSK - Kafka
- Amazon RDS - Relational database service
- Amazon Route 53 - Domain Name System (DNS) web service
- Amazon S3 - Object storage
  - Mountpoint for Amazon S3 - High-performance file client for mounting Amazon S3 as a local file system
- Amazon Redshift - Data warehouse
- Amazon SageMaker - Machine learning platform
- Amazon SQS - Queue
- Amazon VPC - Virtual private cloud
- AWS Batch - Batch computing
- AWS Certificate Manager - SSL/TLS certificate management
- AWS CloudFormation - Infrastructure as code (IaC)
- AWS CodeCommit - Version control
- AWS Glue - Serverless data integration
  - AWS Glue Crawler - Data source discovery
  - AWS Glue Data Catalog - Central metadata repository
  - AWS Glue DataBrew - Data cleaning
- AWS IAM - Identity and access management
- AWS IoT Core - Internet of Things (IoT)
- AWS KMS - Key management service
- AWS Lake Formation - Data lake governance
- AWS ParallelCluster - High performance computing (HPC) cluster management
  - NICE DCV - Remote display
- AWS Secrets Manager - Password management
Google Cloud
- BigQuery - Data warehouse
  - BigQuery ML - BigQuery machine learning
- Dataprep - Data cleaning
- Looker Studio - Data visualization
- Vertex AI - Machine learning platform

Cloud Cost

Komiser - Cloud cost monitoring

Infrastructure

OpenTofu - Infrastructure as code (IaC)
Pulumi - Infrastructure as code (IaC)
Atlantis - OpenTofu and Terraform pull request automation
Ansible - Configuration management and automation
Vagrant - Development environments building and distributing

Ops

Argo CD - Declarative GitOps CD for Kubernetes
- Argo CD Image Updater - Automatic container image updating
Rancher - Kubernetes container management platform
KRR - Kubernetes resource recommendation based on Prometheus metrics
- Simple KRR Dashboard - KRR dashboard
Goldilocks - Kubernetes resource recommendation based on Vertical Pod Autoscaler (VPA)
Polaris - Kubernetes best practices validation
Sloop - Kubernetes history visualization
OpenCost - Kubernetes cost monitoring
Kubecost - Kubernetes cost monitoring
Diun - Container image update notifier
Discord - ChatOps
Opsgenie - Incident management platform
Actions Runner Controller (ARC) - Kubernetes operator for self-hosted GitHub Actions runners
GitHub Actions - Continuous integration

Authentication, Authorization, Security

Defguard - Zero-trust virtual private network (VPN) with WireGuard-based multi-factor authentication (MFA) and single sign-on (SSO)
Ory Hydra - OAuth 2.0 and OpenID Connect server
Open Policy Agent (OPA) - Policy-based control
OPAL - Open-policy administration layer
Falco - Cloud-native runtime security & threat detection
- Falcosidekick - Falco alert forwarding and integration hub
Prowler - Cloud security assessments
CodeQL - Variant analysis
Gitleaks - Git secret scanning
GitGuardian - Git secret scanning

System Tool

Ouch! - Compressing and decompressing program
s5cmd - S3 and cloud object storage command-line tool
Rclone - Cloud storage sync program
restic - Encrypted backup program
Vim - Terminal-based text editor
Zellij - Terminal multiplexer
Just - Command runner for managing project-specific tasks
xxHash - Hash algorithm
Valgrind - Memory debugging and profiling

Reverse Engineering

hexedit - File viewing and editing in hexadecimal and ASCII
xxd - File viewing and editing in hexadecimal and ASCII
strings - Strings of printable characters viewing
objdump - Disassembler
IDA - Disassembler

Ethereum

Solidity - Contract-oriented programming language
solc-js - JavaScript bindings for the Solidity compiler

Digital Design

Verilog - Hardware description language
VHDL - Hardware description language

Embedded System

pySerial - Serial communication library
cantools - Controller Area Network (CAN) bus tools
python-can - Controller Area Network (CAN) bus library
Yocto Project - Linux distribution creating
ROS - Robot operating system
FreeRTOS - Real-time operating system
ASTERIOS - Real-time, safety-critical applications development
OpenSCAD - 3D CAD Modeller
Arduino Uno - Microcontroller board
BeagleBone Black - Microcontroller board
Raspberry Pi 4 Model B - Single-board computer (SBC)
Jetson Nano - Single-board computer (SBC)
Jetson TX2 - Single-board computer (SBC)
RISC-V - Open standard instruction set architecture (ISA)

Simulation

Surrogate Modeling Toolbox (SMT) - Surrogate modeling
AnyLogic - Simulation modeling tool
LabVIEW - Graphical programming environment
VeriStand - Real-time testing and simulation
OpenFOAM - Computational fluid dynamics (CFD)
SimScale - Computational fluid dynamics (CFD), finite element analysis (FEA), thermal simulation
BlueSky - Air traffic simulator
AeroSandbox - Aircraft design and optimization
MATLAB - Programming and numeric computing platform
- Runtime
  - RunMat - High-performance MATLAB-compatible runtime with JIT compilation and GPU acceleration
- Toolbox
  - 5G Toolbox - 5G communications systems simulation, analysis, and testing
    - 6G Exploration Library - 6G communications systems simulation, analysis, and testing
  - Aerospace Toolbox - Aerospace vehicle motion analysis and visualization
  - Automated Driving Toolbox - ADAS and autonomous driving systems design, simulation, and testing
  - Bioinformatics Toolbox - Genomic and proteomic data analysis and visualization
  - Computer Vision Toolbox - Computer vision, 3D vision, and video processing systems design and testing
  - Database Toolbox - Relational and NoSQL databases interacting
  - Lidar Toolbox - Lidar processing systems design, analysis, and testing
  - Navigation Toolbox - Autonomous navigation algorithms design, simulation, and deployment
  - Satellite Communications Toolbox - Satellite communications systems simulation
  - Signal Processing Toolbox - Signal processing and analysis
  - Simulink - Simulation and model-based designing
    - Simscape - Multidomain physical systems simulation
CoppeliaSim - Robotics simulator with a distributed control architecture for fast prototyping, algorithm development, and factory automation
Genesis - Generative world and universal physics platform for general-purpose robotics and embodied AI learning
NVIDIA Omniverse - Collection of libraries and microservices for developing physical AI applications such as industrial digital twins
- NVIDIA Isaac Sim - Application to simulate, test, and validate physical AI-based robots and multi-robotic fleets

Autonomy

nuscenes-devkit - nuScenes autonomous driving dataset toolkit

Aerospace

fr24sdk - Flightradar24 SDK
AeroSandbox - Aircraft design and optimization
OpenAeroStruct - Aerostructural optimization
OpenMDAO - Multidisciplinary analysis and optimization
OpenFOAM - Computational fluid dynamics (CFD)
SimScale - Computational fluid dynamics (CFD), finite element analysis (FEA), thermal simulation
ParaView - Post-processing visualization
PX4 - Flight control software
CubeSat - Miniaturized satellite
QGroundControl - Ground control station (GCS) for unmanned aerial vehicles (UAVs)
X-Plane - Flight simulator

Code

ansible-lint - Ansible linter
dotnet format - C# formatter
CSharpier - C# formatter
ClangFormat - C/C++ formatter
cpplint - C/C++ linter
CMakeLint - CMake linter
commitlint - Commit message linter
Stylelint - CSS linter
DCLint - Docker Compose linter
hadolint - Dockerfile linter
dotenv-linter - dotenv linter
editorconfig-checker - EditorConfig linter
gofmt - Go formatter
golangci-lint - Go linter
@html-eslint - HTML linter
ESLint - JavaScript linter
Prettier - JSON formatter
@eslint/json - JSON linter
Just - justfile formatter
Ktlint - Kotlin formatter and linter
detekt - Kotlin static type checker
Kubeconform - Kubernetes manifest linter
markdownlint-cli2 - Markdown linter
MISS_HIT - MATLAB formatter
textlint - Natural language linter
tofu - OpenTofu formatter
Buf - Protocol Buffers linter
action-semantic-pull-request - Pull request title linter
Ruff - Python formatter and linter
Mypy - Python static type checker
qmllint - QML linter
opa - Rego formatter
RuboCop - Ruby formatter and linter
rustfmt - Rust formatter
Clippy - Rust linter
Scalafmt - Scala formatter
Scalafix - Scala linter
ShellCheck - Shell linter
Solhint - Solidity linter
sqruff - SQL formatter and linter
swift-format - Swift formatter and linter
Taplo - TOML formatter
tsc - TypeScript static type checker
Verible - Verilog formatter and linter
VHDL Style Guide (VSG) - VHDL formatter
@prettier/plugin-xml - XML formatter
yamllint - YAML linter
GitHub - Version control
SonarCloud, Codacy - Code reviews and analytics
Codecov - Code coverage reports
Depfu - Dependency monitoring
FOSSA - License compliance

Design

Fusion 360 - Industrial design
Blender - 3D graphic design
Figma - UX design

Bots

Renovate - Dependency updating
Gemini Code Assist - Code reviewing
CodeRabbit - Code reviewing
Mergify - Automatically merging
Stale - Stale issues and pull requests closing
semantic-release - Version management and package publishing

Testing

Unit testing
Snapshot testing
Visual testing
Instrumented testing
Smoke testing
Sanity testing
Compatibility testing
Integration testing
End-to-end testing
Contract testing
Mutation testing
Penetration testing
Ethical testing
Performance testing
Permutation testing
Holdout testing
Bias testing
Duck testing
Bus testing
Load testing
Durability testing
Fault injection testing
Parallel testing
Acceptance testing
Model-in-the-loop (MIL) testing
Hardware-in-the-loop (HIL) testing
Environmental testing
- Vibration testing
- Shock testing
  - Drop testing
- Temperature testing
- Humidity testing
- Altitude testing
- Icing testing
- Rain testing
- Fungus testing
- Salt fog testing
- Lightning testing
Structural testing
Battery drop testing
Battery vibration testing
Dyno testing
Flammability testing
Wind tunnel testing
Ground testing
Flight testing

Languages

C
- Embedded C
- PsyC
C++
- CUDA C++
C#
CSS
Cap'n Proto Schema Language
Cypher
Docker
Flux
Go
GraphQL
HCL
HTML
Java
- Kotlin
- Scala
JavaScript
- TypeScript
Julia
Just
LabVIEW
LLVM Intermediate Representation (IR)
Lua
Markdown
MATLAB
OpenSCAD
P4
PowerShell
Protocol Buffers Schema Language
Python
- Taichi
- Triton
QML
Rego
Ruby
Rust
Shell
Solidity
SQL
- ANSI SQL
- LogQL
- PL/pgSQL
- PromQL
- SedonaSQL
- Snowflake SQL
- Spark SQL
- TraceQL
Swift
Verilog
VHDL
XML
YAML

Network

Network Programmability

P4 - Programming Protocol-independent Packet Processors

Network Analysis

TShark - Network protocol analyzer

Communication Standard

Open Systems Interconnection (OSI) model
- Layer 1: Physical layer
  - Serial protocols
    - Inter-Integrated Circuit (I²C)
    - Serial Peripheral Interface (SPI)
    - Controller Area Network (CAN)
- Layer 2: Data link layer
  - Ethernet
  - Wi-Fi
- Layer 3: Network layer
  - The Internet Protocol (IP)
    - IPv4
    - IPv6
  - Time protocols
    - Network Time Protocol (NTP)
    - Precision Time Protocol (PTP)
    - IRIG-B Time Protocol
- Layer 4: Transport layer
  - User Datagram Protocol (UDP)
  - Transmission Control Protocol (TCP)
  - QUIC
- Layer 5: Session layer
  - WebSocket
  - Web Real-Time Communication (WebRTC)
  - WebTransport
- Layer 6: Presentation layer
  - Remote Procedure Call (RPC)
    - RPC frameworks
      - Apache Avro
      - Apache Thrift
      - gRPC Remote Procedure Calls (gRPC)
    - Binary data serialization formats
      - Avro
      - Thrift
      - Protocol Buffers (Protobuf)
      - FlatBuffers
      - Cap'n Proto
        
        pycapnp - Python bindings for Cap'n Proto C++ runtime library
        
        capnp-stub-gen - Cap'n Proto Python type stub generator
        
        capnp - Cap'n Proto Rust runtime library
        
        capnpc - Cap'n Proto schema compiler for Rust
- Layer 7: Application layer
  - Hypertext Transfer Protocol (HTTP)
    - Hypertext Transfer Protocol Secure (HTTPS)
    - HTTP/0.9 - TCP/IP
    - HTTP/1.0 - TCP/IP
    - HTTP/1.1 - TCP/IP
    - HTTP/2 - TCP/IP
    - HTTP/3 - QUIC + UDP
  - File transfer protocols
    - File Transfer Protocol (FTP)
      - Secure File Transfer Protocol (SFTP)
    - Server Message Block (SMB)
    - Web Distributed Authoring and Versioning (WebDAV)
  - Email protocols
    - Post Office Protocol (POP)
    - Simple Mail Transfer Protocol (SMTP)
    - Internet Message Access Protocol (IMAP)
  - MQTT

Guideline

Avionics Systems
- DO-178C - Software considerations in airborne systems and equipment certification
- DO-254 - Design assurance guidance for airborne electronic hardware
- ARP4754A - Guidelines for development of civil aircraft and systems
- DO-160G - Environmental conditions and test procedures for airborne equipment
- DO-331 - Model-based development and verification supplement to DO-178C and DO-278A
- DO-330 - Software tool qualification considerations
Drone Systems
- Pixhawk standards - Hardware specifications and guidelines for drone systems development
Automotive Systems
- ISO 26262 - Road vehicles — functional safety
- AUTOSAR - Automotive open system architecture
Industrial Robot Systems
- ISO 10218 - Robots and robotic devices — safety requirements for industrial robots
- ANSI/RIA R15.06-2012 - Industrial robots and robot systems — safety requirements

🏞 Highlight

Autonomy

Camera-Radar-Lidar Fusion

MATLAB Automated Driving Toolbox - ADAS and Autonomous Driving Systems Design, Simulation, and Testing

MATLAB Lidar Toolbox - Lidar Processing Systems Design, Analysis, and Testing

Aerospace

X-Plane - Flight Simulator

OpenFOAM - Computational Fluid Dynamics (CFD)

OpenFOAM simulation results viewed by ParaView.

SimScale - Computational Fluid Dynamics (CFD), Finite Element Analysis (FEA), Thermal Simulation

AeroSandbox - Aircraft Design and Optimization

MATLAB Aerospace Toolbox - Aerospace Vehicle Motion Analysis and Visualization

MATLAB Satellite Communications Toolbox - Satellite Communications Systems Simulation

AnyLogic - Simulation Modeling Tool

The following presents a model of a radar-based air defense system. Bombers are dispatched to destroy ground facilities, while the buildings are safeguarded by the air defense system, comprising two radars equipped with guided surface-to-air missiles.