Includes Layer-Major Double Buffering (Prefetch Hiding) simulation and Model Presets
Model Preset
Hardware Architecture
Model Parameters
Hardware Tiers
Capacity (GB)
Bandwidth (GB/s)
Capacity (GB)
Bandwidth (GB/s)
Capacity (GB)
Bandwidth (GB/s)
Reading Strategy
Enable Pipelining Layer-major double buffering
PIPELINED
Estimated Decode Speed
Bottleneck: Calculating...
Model Weights Analysis
Model Allocation & Native I/O Times
VRAM 0 GB
Native read/tok: 0 ms
RAM 0 GB
Native read/tok: 0 ms
SSD 0 GB
Native read/tok: 0 ms
Without Pipelining: Times are added linearly.